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MEASUREMENT AND PROGRESS IN EDUCATION 


Ernest W. Trees 
UNIVERSITY OF SOUTHERN CALIFORNIA 


NE of our contemporary philoso- 
O phers has said that in the ulti- 

mate analysis our troubles are 
due to dogma and deduction. We find 
no new truths because we take some 
venerable but questionable proposition 
as an indubiable starting point and 
never think of putting this assump- 
tion itself to the test of observation 
and experiment. For example, there 
once arose the belief that night air is 
bad; and come what might, education, 
ridicule, the pronouncements of medi- 
eal science, and all other evidence to 
the contrary notwithstanding, many 
good folk of the past generation went 
to their graves with the firm conviction 
that night air is dangerous. 

The field of education is not with- 
out its superfluous burden of dogma 
and superstition. Teachers on every 
level from the kindergarten to the 
graduate school still believe that they 
can adequately measure achievement 
or intelligence by looking at a student 
or hearing him speak; others have 
heard of intelligence tests and are un- 
der the impression that they are 
dangerous; still others believe that the 
passing mark is a simple, stable stand- 
ard, in defense of which they would 
give their professional lives, rather 
than a fiction of the imagination. 
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Still others believe that the traditional 
examination is a measurement instru- 
ment. Rating schemes without num- 
ber and a host of impossible, amateur- 
ish devices flourish like the green bay 
tree in a profession which has the 
opportunity, the motivation, and the 
facilities for doing its work efficiently, 
effectively, and scientifically. 

The task of applying the resources 
of measurement to practical problems 
in education has been complicated in 
the past, not merely by the dearth of 
experimental studies in many fields, 
which has forced teachers to pursue 
their activities unguided, or shall we 
say unhampered by facts; too often 
members of the profession have oper- 
ated in distinct hostility to well-known 
facts. Before they were well launched 
in the profession to become their life’s 
work, they have developed certain 
mind sets. They have hugged their 
illusions; they have feared changes in 
ideals, attitudes, and practices which 
would disturb their naive beliefs, to 
which they have clung as to a religion. 
Those to whom this description applies 
have soon lost their contact with the 
world of educational reality, and they 
have become strangers in a strange 
land. 

We as teachers have agreed that it 
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is our objective to do more and better 
teaching, in order that the lot of chil- 
dren may be improved; and then we 
have done all in our power to prevent 
any change in the status quo, because 
it always involved additional learning 
and adjustment. 

But the profession moved on; re- 

sarch revealed new truths; new de- 
vices and procedures were invented to 
apply these truths; but the thinking 
and educational procedures of only a 
very small part of the profession 
changed with needs and with the 
times. 

Thus the world at large with its 
troubles and problems had its counter- 
part in the field of education — a rela- 
tively small group of leaders and a 
great body of more or less unthinking 
followers. The minds of the rank and 
file of the profession were cluttered 
with the dead husks of past reality 
which had long been discarded by 
those who had gone on learning and 
thinking. 

During the past ten to fifteen years, 
a new spirit has permeated the profes- 
sion. Workers in education have be- 
come aware of the fact that with the 
spread of democratic concepts in edu- 
cational organization and practice, 
with greater freedom and greater re- 
sponsibility for teachers, it is essential 
that they should receive a more thor- 
ough, scientific training and a wider 
knowledge and more profound under- 
standing of their problems in order 
that this responsibility may be ade- 
quately discharged. 

In his volume on “Making the Most 
of High School,” Dr. Clyde Hill of 
the Yale School of Education, com- 
ments on the importance of mathe- 
matics in ancient civilization and the 


crucial part which it has played in th 
development of modern civilization, jg 
the sciences, the professions, and in 
every-day life. Tests and measure. 
ments are simply the mathematics of 
Education. They are simply the mean 
of substituting more accurate, reliable, 
and valid information to serve with 
other concomitants, as the rational 
basis for educational activities, 

It is no longer necessary to guess at 
the extent of certain learning diffieyl- 
ties. They can be diagnosed. We 
need no longer merely argue about 
motivation; the effects of certain types 
of motivation may be tested in the 
same way that classification, ability 
grouping, guidance, marking and pro- 
motion, and other classroom activities 
inay be studied,—in the light of objec 
tive evidence. The evaluation of text- 
books and instructional procedures 
may be approached in a spirit whieh 
eliminates to a large extent the influ 
ence of personal prejudice or political 
pressure. The evaluation of teaching 
efficiency may proceed with a clear 
understanding of the pitfalls which in 
the past have attended it; however 
undesirable the implication, there is n0 
cuestion but that the average rating 
plan is constantly in danger of having 
much in common with discredited 
plens for character rating. 

Better quantitative procedures are 
as inevitable in education as they have 
been in other fields. It is just a ques 
tion as to how soon teachers receive 
adequate training for this phase of 
their responsibility. In spite of tradi- 
tion, superstition, inertia, and misul- 
derstanding, which constitute constant 
resistance to change, increasingly acew 
rute knowledge has conditioned prog 
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gress in other fields and gives great 
romise of unusual significance in edu- 
cation. The immediate task is to make 
teachers aware of the resources of 
measurement, and to provide them 
with the minimum working tools not 
only in expediting and improving 
classroom procedures, but in improv- 
ing all techniques which are related to 
the educational process. Whether 


those techniques be related to improved 
teaching, improved materials of in- 
struction, improved supervision, or im- 
proved administration, there is hardly 
a problem in which the classroom 
teacher does not have a vital interest. 
A training in measurement will serve 
not only as the means to progress, but 
as a method of evaluating whatever 
progress is made. 


SUPERIOR SCHOLASTIC APTITUDE AND SUCCESS 
IN COLLEGE 


Frank C. Tovron 


VICE-PRESIDENT AND DIRECTOR OF EDUCATIONAL PROGRAM 
AND 


Berry Trrer Berry 


ASSISTANT PROFESSOR OF ORIENTATION 
UNIVERSITY OF SOUTHERN CALIFORNIA 
The authors point out that the very superior students, as indicated by scholastic apti- 
tude tests, are not as likely to make a superior record in college as are those with less 
ability. Is this the fault of the student, of the instructor, of the college curricula, 
or of the elementary and secondary school training? 


Introduction. 

ANY investigations have been 
M made and reported on in the 

field of prognosis of college 
marks. The relation between scholas- 
tic ability and academic performance 
is in general disappointingly low due, 
it seems, to two chief causes, namely, 
the unreliability of instructor’s marks 
and the distractions of college life. On 
the former (unreliability of marks) 
ne comment will be made other than 
to say that reliability of marks seems 
te vary with the objectivity, validity, 
aud reliability of the tests used in 
measuring scholastic achievement. At 
this time more consideration will be 
given to factors which seem to influ- 
ence academic success. Our attention 
will be focused on the levels of achieve- 
ment attained by college students of 
very superior and superior scholastic 


aptitude. The single measure of apti- 
tude used in cases reported here is the 
Thorndike Intelligence Examination 
for High School Graduates. The 
group considered is limited by the fact 
that this examination, though required 
of freshman entrants, is not taken by 
students admitted to sophomore and 
higher standing. The cases reported 
on will be in each instance less than 
the total group of entrants and will be 
selected from the higher levels of 
scholastic aptitude as measured by the 
Thorndike Examination. With the 
data available, an attempt will be 
made to seek an answer to the ques- 
tion: “Do very superior and superior 
college students achieve the scholastic 
suecess predicted by their differential 
mental capacities ?” 

In the Experimental Entrance 
Croup. As has been announced in the 








public press, the University of South- 
ern California has now in progress a 
three-year plan, during which time 
from seventy to one hundred students 
will be admitted each year on a basis 
of entrance somewhat different from 
that used for admission to regular 
standing. Applicants who are accepted 
for this group are all graduates from 
accredited secondary schools and un- 
der twenty-one years of age. They 
have less than the required number of 
eutrance units of recommending qual- 
ity; they all have had the usual sec- 
ondary school training and are recom- 
mended as to character and judged 
worthy of an opportunity to attend 
college for at least one year. 


The final selection of members for 
this group is made by a committee 
which examines the entrance test rec- 
ords made by all applicants in a series 
of eight different tests. Students who 
are admitted thus are expected to 
achieve a scholarship average of 1.0 
(©) or higher in the work of a full 
year in order to remain in the univer- 
sity. If they succeed in doing so, they 
become sophomores; if they do not 
achieve a scholarship average of 1.0, 
they are dropped from the university 
and may not be readmitted until they 
meet in full the regular entrance re- 
quirements. 

During the past year a critical 
study has been made of the equipment, 
methods of study, and progress of this 
group. 

In the first semester of the experi- 
ment, it was found that five members 
of this group were placed in scholastic 
pptitude among the highest seven per 
cent of the students regularly admitted 
to the university during the preceding 
three years. We would expect these 
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five students to achieve excellent schol. 
arship averages in their course work. 
Instead, four out of this group of fiy. 
students failed during their first ge. 
mester to make a scholarship average 
of 1.0. One failed almost completely 
and withdrew at the end of the first 
semester. Of the four who remained 
through the second semester, two 
failed in the work of the full : 
of the other two, one barely Be 
Thus there is only one of the five 
whose performance is consistent with 
his brilliant promise, and who has 
achieved a superior academic record, 

When we consider the members of 
this group who were rated superior, 
though not very superior, we find a 
different result. Of the sixteen mem- 
bers of this group who are rated supe- 
rior (B) in scholastic aptitude, thir 
teen (over 80 per cent) earned a satis 
factory scholarship average during the 
first semester. One of these thirteen 
did not return for the second semester, 
while the three whose records for the 
first semester were unsatisfactory did 
return. During the second semester, 
then, fifteen students in the experi- 
mental entrance group were of supe 
rior scholastic aptitude. All but one 
of these finished the year with a schol- 
astie average over both semesters of 1.0 
or better. 

It appears from our records of this 
group admitted and taught as experi- 
mental entrance students, those rating 
conspicuously high in scholastic apti- 
tude were not as a group as consist 
ently successful in their college work 
as were those members of the group 
who rated high in scholastic aptitude 
yet lower than the highest seven per 
cent. Conspicuously high aptitude 


records predict college success with less 





aE 


ef 


ARFEFAZRSEPES 


of 2 


a 


So F 


s 


a, te le 








SUPERIOR APTITUDE AND SUCCESS IN COLLEGE 389 


certainty than do merely superior apti- 
tude records. Superior performance 
in this group goes more often with 
superior than with very superior apti- 
tude records. 

Records of regularly admitted stu- 
dents. Since it appeared that supe- 
rior performance went more certainly 
with superior aptitude than with very 
superior aptitude in the case of stu- 
dents admitted to the experimental en- 
trance group, the question was raised 
as to whether this relation holds in the 
ease of students admitted regularly. 
For this purpose the entering class of 
1931 was chosen for study. There 
were 49 members of this class who 
were rated very superior (A) in schol- 
astic aptitude. Of this group of 49 
students, 32 (64 per cent) rated C or 
higher in their academic work of the 
first semester, while 17 (36 per cent) 
made unsatisfactory records, in many 
cases very unsatisfactory. 

Some 161 students in this class were 
rated as just superior in scholastic 
aptitude as shown by the test. Of this 
superior group of 161 students, 132 
(82 per cent) made satisfactory schol- 
arship records during their first semes- 
ter, while 29 students (18 per cent) 
did not. 


The second semester records merely 
repeat the same story that is told by 
the first semester. Here 41 students 
of very superior scholastic aptitude 
completed the work of the second se- 
mester; 25 (61 per cent) did satisfac- 
tory academic work, while 16 (39 per 
cent) did not. For this second semes- 
ter the group rated superior in schol- 
arship numbered 141, of whom 114 
(81 per cent) did satisfactory aca- 
demie work, while 27 (19 per cent) 
did not. It appears that about two 


out of every three very superior and 
four out of every five of the merely 
superior students in scholastic apti- 
tude achieve satisfactory academic rec- 
ords. 

Even though the students rated su- 
perior (B) in scholastic aptitude are 
more certain to succeed as individuals 
than are the students rated very supe- 
rior (A) in scholastic aptitude, yet the 
average achievement of the very supe- 
rior group is higher than that of the 
superior group, for those of the very 
superior group who do succeed achieve 
very superior records. 

It is recognized that the observations 
made above are drawn from a study of 
relatively few cases. 


An explanation seems again to come 
from the close-up study of the mem- 
bers of the experimental entrance 
group. For these students, the records 
show that practically all of the very 
superior students are placed either 
above the ninety percentile or below 
the ten percentile point of the nor- 
mal group in personality traits as 
announced by the Bernreuter Person- 
ality Inventory. Thus the very supe- 
rior members of the Experimental En- 
trance Group show marked personality 
quirks and eccentricities. It seems 
reasonable to assume that, in general, 
students with marked scholastic apti- 
tude may possess such personality pe- 
culiarities as will probably stand in 
the way of their success. Such stu- 
dents dislike routine tasks and require 
teachers of unusual ability and re- 
sourcefulness. 

Scholastic aptitude and marked 
achievement for the entire course. The 
June, 1932, commencement program 
shows the names of 49 graduates who 
achieved magna cum laude or cum 
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laude mention, and for whom the uni- 
versity records show scholastic aptitude 
scores taken during the freshman year. 

Of the 13 students who achieved the 
magna cum laude recognition and for 
whom scholastic aptitude records were 
on file, 5 (37 per cent) were in the 
very superior, 7 (55 per cent) in 
the superior, and 1 (8 per cent) in 
the average scholastic aptitude group. 
Of the 36 students who achieved the 
cum laude recognition and for whom 
aptitude records were on file, 4 (11 
per cent) were in the very superior 
and 4 (11 per cent) in the average, 
while 28 (77 per cent) were in the 
superior aptitude group. 

Here we see that the superior rather 
than the very superior scholastic apti- 
tude students achieve a higher percent- 
age of both the magna cum laude and 
cum laude graduation scholarship rec- 
ognitions. The highest places on the 
commencement program seem to have 
been reserved for the most part for stu- 
dents who showed only superior schol- 
astic aptitude at entrance, a few being 
left for very superior students in 
scholastic aptitude, and an occasional 
place is held for the college entrant of 
average scholastic aptitude. 


Reference to another commencement 
program confirms the above findings. 
Here we have scholastic aptitude scores 
for 6 of the 1931 graduates with 
magna cum laude and for 24 gradu- 
ates with cum laude. One magna 
cum laude graduate (18 per cent) 
rated very superior in scholastic ability 
at entrance and 5 (82 per cent) supe- 
rior in scholastic ability. Of the 24 
cum laude graduates for whom records 
were available, 4 (11 per cent) were 
rated very superior in scholastic abil- 
ity at college entrance, 18 (67 per 
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cent) superior, and 2 (8 per cent) 
were of average scholastic ability, 

Scholastic aptitude and membership 
in honor societies. Two natio 
known scholastic honor societies elect 
members each year from among gradu. 
ates who earn academic records plag- 
ing them in the highest ten per cent 
of the graduating class. Since certain 
of the members elected to these goci- 
eties entered the university as fresh- 
men, it is possible to examine their 
scholastic aptitude records and note 
the relationship which exists between 
very superior scholastic aptitude ree- 
ords and election into scholastic honor 
societies. 


Of the group elected in 1932 to Phi 
Beta Kappa, a national Liberal Arts 
scholarship society, 19 seniors had 
scholastic aptitude records on file. Of 
the 19 seniors, only 4 (21 per cent) 
had very superior scholastic aptitude 
records, while 15 (79 per cent) had 
superior or average records. In June, 
1931, 11 seniors whose scholastic apti- 
tude records were on file were honored 
by Phi Beta Kappa election. Of 
these 11 students, 3 had very superior 
scholastic aptitude records while 8 had 
records showing only superior or aver- 
age scholastic aptitude. 

For Phi Kappa Phi, a national 
scholarship society which draws its 
members from the several schools and 
colleges of the university, the story is 
much the same. In 1931, there were 39 
members elected for whom scholastic 
aptitude records were available for this 
study. Of this group, 11 (28 per 
cent) rated very superior in scholastic 
aptitude at college entrance, while 28 
(72 per cent) rated superior or aver 
age in aptitude. In June of 1932, 
there were 50 new members elected 
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whose aptitude records are known, 
only 11 (22 per cent) of whom en- 
tered with very superior scholastic 
aptitude records. 

The above facts indicate that mem- 
bership in national scholarship soci- 
eties is achieved not alone by the stu- 
dents who show very superior scholas- 
tie aptitude at college entrance, for 
the membership lists for two consecu- 
tive years show the names of from 
three to four times as many superior 
and average aptitude students as of 
students of very superior scholastic 
aptitude. 

Correlation between aptitude and 
achievement. When a scatter diagram 
is made showing the relation between 
scholastic aptitude and academic 
achievement for entrants of Septem- 
her, 1931, we find a Pearson correla- 
tion of 0.32 + 0.02, a finding which 
is in agreement with the results of 
previous studies. The group of 1931 
freshman entrants may be taken as a 
typical University of Southern Cali- 
fornia entrance group. ‘The relation- 
ship shows two distinct trends: in one 
there is notable consistence of per- 
formance with aptitude—high perfor- 
mance with superior aptitude and low 
performance with inferior aptitude— 
while the other indicates that there 
are a considerable number of students 
with very superior aptitude who show 
average or low achievement perfor- 
mance. 

The scatter diagram shows this fact 
quite clearly. Most of the scores take 
their places in the diagram relatively 
near to the diagonal which runs from 
lower left to upper right of the field. 
A few records, however, form a sort 
of wedge, broad in the upper left-hand 
corner and narrowing toward the cen- 


ter of the field, where it is merged 
with and lost in the other records. 

A study of this correlation seems to 
give support to the belief that among 
students of very superior scholastic 
aptitude, two distinct sets of perfor- 
mances may be expected. Some achieve 
superior mastery of conventional sub- 
ject matter with the usual methods in 
class group situations, while a consid- 
erable part of these very superior apti- 
tude students possess erratic traits and 
personality conflicts which make it 
difficult for them to adapt themselves 
to the usual school situations. They 
seem to fail to develop social group 
traits sufficiently well to succeed even 
approximately near the level of their 
capacities. In fact, many find them- 
selves so hopelessly out of step with 
other students that they either drop 
out of college altogether or, if they 
remain in college, seek other major 
avenues of self-expression and con- 
tinue on in course work with but medi- 
ocre achievement. 

Résumé. An answer is sought to 
the question “Do students of superior 
rather than very superior scholastic 
ability achieve with greater certainty 
the superior academic records ?¢” 

Of the students admitted in the 
1931 experimental entrance group at 
the University of Southern California, 
those rating conspicuously high in 
scholastic ability are not as a group as 
successful in their college work as are 
those members of the group who are 
rated as superior, yet less brilliant. 
For the group, very high aptitude rec- 
ords predict college success with less 
certainty than do merely superior rec- 
ords. With the experimental entrance 
group superior performance goes more 





often with superior than with very 
superior scholastic aptitude records. 
The study of the very superior and 
superior members of the 1931 group 
of entering freshmen at the university 


indicates that four-fifths of the supe- 


rior students and only two-thirds of 
the very superior students in scholastic 
aptitude achieve satisfactory academic 
records. Personality quirks and per- 
sonal eccentricities seem to impede the 
progress of many scholastically very 
superior students. These seem to ad- 
just and adapt themselves less well to 
the usual school environment and pro- 
cedures. 

From a study of entrance scholastic 
aptitude records of students who are 
graduated magna cum laude and cum 
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scholarship societies’ graduation ligts 
shows that membership in national 
honor scholarship societies is achieved 
not alone by the students who shoy 
very superior scholastic aptitude gt 
entrance to the university, for the 
membership lists of these societies 
show from three to four times gs 
many names of students of superior 
and average scholastic ability as ap- 
pear for students of very superior 
scholastic aptitude. 

An analysis of the factors whieh 
produce the seemingly uncertain relg- 
tionship between scholastic ability and 
academic achievement for college stu- 
dents indicates two distinct trends: a 
major trend of positive relationship 
between superior ability and high 


laude it appears that students of supe- 
rior, rather than very superior, schol- 
astic aptitude achieve the higher per- 
centage of the conspicuous scholarship 
honors at graduation. Places of high- 
est honor on the commencement pro- 
gram seem to be reserved for students 
who show superior rather than very 
superior scholastic aptitude at college 
entrance 

A study of the Phi Beta Kappa 
and Phi Kappa Phi national honor 


achievement and another counter, vet 
marked, trend indicates that 
many very superior students do medi- 
ocre or failing work while some stu- 
dents of mediocre talent do work of a 
surprisingly high grade. 

The answer to the question stated 
at the outset seems to be: Students of 
superior, rather than very superior, 
scholastic ability seem to achieve with 
greater certainty the superior academic 


records. 


which 
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MEASURING THE RESULTS OF RELIGIOUS 
EDUCATION 
Roy G. Bosz 
CALIFORNIA CHRISTIAN COLLEGE, LOS ANGELES 


Professor Bose makes a plea for a better apprecidtion of the value of tests as teaching 
instruments. Religious and character education are no exceptions to the general rule 


that only through measurement can we 


discover the relative effectiveness of our 


teaching methods. 


Relation of Schoolman to Religious 
Education. 


HOULD a schoolman be interested 
in evaluating the results of re- 
ligious education’ My answer 

is emphatically in the affirmative. The 
child is a unit. His head cannot be 
sent to school, his body to the play- 
ground, and his soul to church. He 
takes his entire self with him in all 
his explorations of life. Therefore the 
process which educates him must be 
unified, and the one who supervises 
his education must be interested in 
that entire process. He should know 
what results are being obtained in 
other fields than his own. 

I am not advocating that the school- 
man should become responsible for the 
religious education of the child. There 
is a vast difference between an intelli- 
gent interest in this phase of a com- 
plete education, and using the public 
school as an agent in fostering it. Be- 
eause of his position of educational 
leadership in the community, the 
schoolman should be able to furnish 
expert advice, and leadership, particu- 
larly in testing and statistically evalu- 
ating the results of religious instruc- 
tion. 

In some fifteen hundred communi- 
ties in the United States at the pres- 
ent time, week-day schools of religious 
education are being conducted. Many 
of these are on “release-time” or peri- 


cds given during the school day, when 
the child is released from the school 
to go to a place designated by the 
churches for religious instruction. 
How can the schoolman effectively 
evaluate such work without a knowl- 
edge of the methods and materials now 
available for doing so? 

Other considerations demand that 
the attention of the schoolman be di- 
rected to the techniques developed by 
the leaders in the field of religious edu- 
cation. Character education, which is 
rapidly becoming the major concern of 
education, has found its greatest ally 
in the leadership of religious educa- 
tion. Hartshorne and May, leaders in 
the “Character Education Inquiry,” 
G. H. Betts, of Northwestern Univer- 
sity, W. C. Bower, with his book 
“Character through Creative Experi- 
ence,” Goodwin B. Watson, author of 
“Experimentation and Measurement 
in Religious Education,” and a host 
of others, work effectively in both 
fields. Religious education is increas- 
ingly emphasizing character outcomes 
and personality development. The 
schoolman who would develop intelli- 
gently a program of character educa- 
tion in his school cannot ignore this 
leadership. 


Religious Education and Character 
Education Defined. 

I have used, repeatedly, the terms 

religious education and character edu- 
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cation. They are easier to use than 
to define. For the purpose of this dis- 
cussion, I will define religious educa- 
tion as teaching having a religious mo- 
tivation and character education as 
education with the “cultural” and 
“citizenship” emphasis. Immediately 
you question the distinction, and ask 
if religious education does not issue in 
cultural values and good citizenship ‘ 
Therein lies the present confusion. 
The outcomes are the same. The moti- 
vation is somewhat different. 

Another question may be raised as 
to the distinction between these forms 
of the educative process and that 
which we commonly call “Education.” 
The older knowledge-centered view- 
point made the learning of the tool- 
subjects the end of education. Reli- 
gious education had no place, and 
character outcomes were only inciden- 
tal. With our newer emphasis of 
citizenship, education and character 
education are becoming synonymous. 

Those concerned with the educative 
process, therefore, must be interested 
in evaluating the results of the charac- 
ter development in all phases of life. 
It becomes the duty of the schoolman 
to know the techniques in the field of 
religious and character education as 
well as in his own. 


Test Materials and Methods in Rellt- 
gious and Character Education. 


We now come to-the problem which 
occasioned the writing of this paper. 
It is, in brief, What materials and 
methods are available at the present 
time for measuring the results of reli- 
gious and character education? The 
answer must be introduced by the fol- 
lowing statement. There are no tech- 
niques available for religious educa- 
tion that are not equally open to any 


EDUCATION FOR MARCH, 1933 





other phase of education. 


m. Religion 
has no unique forms, which cannot be 
measured by the methods now being 


evolved. That which exists in some 
form can be measured in some way. 
The task is but to find the right meg. 
suring rod. The difference betweey 
religious education and the other forms 
of education lies in the materials used, 
and the outcomes to be measured. The 
measurable quantities are knowledge 
and attitudes. 

In the realm of knowledge ont- 
comes, a number of tests have been 
evolved. A few of these are: Whit- 
ley’s Biblical Knowledge Tests; Giles’ 
Sunday School Examination A; Lay- 
cock’s Test of Biblical Information: 
Union Test of Religious Ideas; Fah’s 
Biblical Test, and Bose’s Religions 
Concept Test. A more complete list- 
ing of tests of this character, together 
with the name of the publisher, price, 
purpose, validity and reliability, will 
be found in Watson’s Experimentation 
and Measurement in Religious Eduea- 
tion. Another source of supply is the 
Association Press, New York. 


In the realm of attitudes, which is 
the most important emphasis in reli- 
gious and eharacter education, there is 
an even larger number of available 
tests. Such tests as Watson and 
Chassell’s, Emotional History Record; 
Fernald’s, Ethical Perception Test; 
Hart’s, Test of Social Attitudes and 
Interests; Koh’s, Ethical Discrimina- 
tion Test; Union Test of Ethical 
Judgment; Chapman’s, Test of Mo 
tives, and the Y. M. C. A. Character 
Growth Tests are representative in the 
field of measurement of attitudes. 
Many others will be found listed in the 
sources given above. These tests are 
usually difficult of administration, and 
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ion should be given only by some one by the care taken in the construction 
he trained in technical procedure. of the statements. 
ing Construction of Tests. 2. Completion Question Tests. 
a In addition to the available stand- A ee 18 cine — — 
= ardized tests, one who would measure you "a. an words have * 
een the results of religious and character omitted. e Ttollowing are sample 
ms education must know how to construct statements. 
ed, his own tests. Most of the tests con- third i ae mn oe . te the 
The structed in the local community or the b, ear ds We port He sideet oe 
dge local church school must necessarily be fase 

ty measure Biblical or other informa- The cas snneesian de ne 
ut tion. Attitude tests are of such a dif- pouaplatiogn the re ails idle 
pen foult nature as to require a highly blank with the word or words he feels 


technical procedure, not available in 
les’ the average local situation. It would 
be preferable to use standardized tests 
in eases where attitudes are envolved. 
h’s The leaders and teachers of the aver- 
age church school could be taught to 


to be right. This form of test is easy 
of construction, but difficult to score, 
because in some cases a variety of 
answers may be possible. The number 
of blanks should be kept small, prefer- 


ous ‘ , : ably one. Each blank should eall for 

ist- repeated a. weer a iatoemetion — cnly a single idea or word. This type 

we which aid materially in evaluating or ead possesses the advantage of 

ce, a em , i ll Mts emphasis upon the right answer. 

: As to the types of objective tests . : ‘ 

es possible of construction for the meas- 8. ‘ Multip te-Chotee Question Test. 

~*~ uring of information, the following This type of question 18 made up of 

nv eve the most common. : car: which may be completed 
1. True-False Question Tests. ) ee ming ne eee 

choices. 

is A statement is given, and the sub- a. The Lord’s Prayer pictures God 

eli- ject indicates by “true” or “false,” or on 

> is plus or minus or a “T” or an “F,” Judge, King, Avenger, Father. 

ble whether he believes the statement to b. The Parable of the Lost Coin 

nd be true or false. The following are bag wie 3 eisai 

; . We should ne , 

4; simple statements. 2. We should sweep the nl 

st; a. Peter was known as the beloved often. 

nd disciple. True. False. 3. All people are careless. 

na- b. The 23rd Psalm was written by 4. Everyone is precious in the 

aa Isaiah. True. False. sight of God. 

fo- The above form is easy to score, is The advantages of this type of test 

ter purely objective, and allows for exten- is that it is objective, and easy to con- 

the sive sampling in a limited time. There struct. A process of judgment is re- 

es. are certain limitations to the use of quired in questions of opinion, ete. 

the the true-false questions, mainly, the The limitations lie in the construction, 

wre danger of implanting false ideas. The wherein the possible choices are not 

nd success of this method is conditioned clearly differentiated. There should 











be at least four or five responses, each 
possessing some degree of plausibility. 

Several other types of objective tests 
of easy construction could be given, 
such as the Matching Tests, where 
lists of answers are matched with item- 
ized statements; the Simple Recall 
Tests, which are simplified completion 
tests. A complete analysis of these 
tests may be found in such a book as 
Ruch’s The Objective or New Type 
Examination. 


Principles Underlying Test Construc- 
tion and Selection. 


A few simple questions should be 
raised with those whom we would 
train in the construction and selection 
of tests in these fields. They are: 

1. What do I want to test? The 
kind of information or the particular 
phase of character development should 
be decided upon. Also it should be 
remembered that all materials are not 
equally important, nor can a test be 
all inclusive. The selection of the 
important items according to some 
plan is essential. 

2. What method of testing will 
most adequately reveal the informa- 
tion or attitudes I am seeking to find? 
With a choice of a score or more pos- 
sible methods, a selection on the basis 
of end in view must be made. 

3. How can I be sure that the test 
measures that which it purposes to 
measure? One must know something 
of its validity and reliability, and the 
method of its standardization. A 
knowledge of elementary statistics, 
thus, becomes essential to anyone 
working with tests, no matter what 
the field. 

4. Which tests will fulfill the above 
conditions and yet have an ease of ad- 
ministration, so that they may be used 
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by others than experts? The form of 
test, the adequacy of directions, and 
the objectivity of scoring must be eon. 
sidered in constructing or selecti 
tests. The tests should be of such g 
character that they could be adminis 
tered by a fairly well-educated person, 
who has been given some training jp 
this field. 

5. Is the test simple and easy to 
score? The test which requires an 
claborate and intricate system of seor- 
ing will discourage the average user, 

6. In what ways can the results of 
the test be made available in further. 
ing personality growth? The ultimate 
value of any test lies in its usefulness 
as a means of furthering character 
development. To merely gather in- 
formation is vicious. Also the tests 
should not be made to say more than 
the contents justify. 

Necessary Statistical Measures. 

In order to understand the meaning 
of standardized test terminology and 
to interpret the results of the tests 
given, one must know a number of 
more or less technical terms. Certain 
simple procedures such as finding the 
mean, mode and median, ete., are e 
sential to any understanding of the 
measures. Seores take on 
meaning as they are related to other 
Johnnie’s rating is under 
standable only in relation to the others 
of his class, ete. 

One method of so relating scores is 
by distribution, either from lowest to 
highest, or by ranking highest as 1, 
next as 2, down the scale. If one 
would find out how the group reacted 
as a whole, a frequency distribution 
of the scores is necessary, which re- 
veals how many persons made each 
When the distribution has been 
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score. 
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determined, a number of things may 
be learned about the group. First, 
the mean or average score of the group 
may be found by adding the scores 
and dividing by the total number. 
This will give the score which is the 
average of the group. With this meas- 
ure the group may be compared to 
other groups. 

Other means of central tendency are 
the mode and median. The mode 
which connotes the popular or most 
frequent score, and the median which 
indicates the middle score of the group 
are both easily found and are good 
measures of comparison. The one 
who would interpret results should 
know, further, how to divide the dis- 
tribution into quartiles, so that each 
quarter group might be studied. Other 
methods of interpretation such as the 
average and standard deviation, corre- 
lation, reliability and validity, ete., 
are necessary factors in understanding 
the results of tests. 


Use of Results. 


The information thus gathered and 
evaluated should be presented to the 
administrators of the church school, 
the teachers, and, in some cases, to 
the parents. The problem of the most 
effective method of presentation of 
results is bound to be raised. The 
written report is usually confusing in 
the multitude of its findings. A bet- 
ter method is that of graphs, which 
picture the results in high relief. 
Again it will be found necessary to 
teach some techniques of graph mak- 
ing to those who aid in presenting the 
results of testing. 

In this brief article, I have sought 
to show the experimental approach 
can be and is being applied to the prob- 
lem of measuring the results of reli- 
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gious and character education. The 
greatest lack in these fields is not ade- 
quate tests, but trained workers, and 
an appreciation of the value of tests. 
Therefore I have appealed to the 
schoolman to bring his training and 
leadership into this field. I have 
listed a few of the standardized tests 
in the field, and suggested a few meth- 
ods of constructing and interpreting 
simple tests. As the article draws to 
a close, it would be well to emphasize 
a point of view that we must promote, 
namely, that anything that exists can 
be measured if instruments can be 
constructed to do so. Tests are merely 
objective ways of measuring. There 
will be found those who contend that 
religious attitudes, emotional reac- 
tions, ete., cannot be measured, be- 
cause of their variable nature. The 
only answer is that they are being suc- 
cessfully measured. There is still 
much to be done in this field, as the 
measurement of personality factors is 
far more difficult than the measure of 
knowledge outcomes. If we could edu- 
cate the church school leadership to 
take an experimental attitude, wherein 
they seek to evaluate the results of 
the work done in an objective way, we 
would have made considerable prog- 
ress. 

There are definite limitations to 
measurement as now evolved. The 
limitations are found in the inaceu- 
racy of the tests, and the uncritical 
acceptance of results of tests. Too 
great reliance upon results obtained by 
the present group of tests is as unsci- 
entific as the rejection of all results. 
A middle ground of appreciation and 
sane use is the point of view to urge 
upon the ones concerned. 


Some will argue that the final test 











398 


of religious and character instruction 
is not in the response to tests, but in 
life itself. To this I would heartily 
agree, but I would insist that I be 
privileged to evaluate that life objec- 
tively at different stages along its 
progress of development. We do not 
wait until the child has become an 
adult to find out his mental equipment, 
but measure his progress at various 
stages along the way. Let those in 
other fields be as wise. Many times 
the cry is raised that common sense 
judgment is enough, but common 
sense should tell us to use the most 
scientific methods in discovering val- 
ues. 

The reader has noted, I am sure, 
the great similarity between measure- 
ment in religious and character edu- 
cation, and that in the field of genera! 
education. One can readily see that 
the methods must be the same. There 
is not one scientific method for religion 
and another for the other phases of 
life. The points of view are the same; 
the materials and ends 
Therefore, it is hoped 


are different. 
that religious 
and character instruction and general 
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instruction may find an increasj 
common ground in the great task of 
developing worthy personalities, 

In some phases of measurement, re 
ligious and character education haye 
made greater progress than has genera] 
education. General education has 
been mainly concerned with discover. 
ing I.Q. and A.Q. ratings for the 
purpose of classifying pupils, while 
the other branches of education have 
concerned themselves with personality 
growth outcomes. The outstanding 
work of the “Character Education In- 
quiry” under the leadership of Hart- 
shorne and May in this connection is 
2 notable example of excellent scien- 
tifie procedure in determining charac 
ter outcomes. 

The future success of all education 
lies in its united effort and its scienti- 
fic attitude. Increasingly the common 
aim must be character development. 
All the forees in the community must 
this end. 
Means of evaluating these forces must 
be evolved. 


be made to contribute to 


Tn this the schoolman will 
play a large part. 
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MEASUREMENT IN EDUCATIONAL FINANCE 


Wiis W. CrarK 


DIRECTOR OF ADMINISTRATIVE RESEARCH 
LOS ANGELES COUNTY SCHOOLS, LOS ANGELES, CALIFORNIA 


Comparison with someone else is the common basis of measurement. “How do our 

salaries, buildings, cost per pupil, costs for operation of the plant, etc., compare with 

other schools?” These are questions constantly asked of every school superintendent. 

Mr. Clark points out how a better system of measurement will enable the superin- 
tendent to give a more correct answer. 


HE financial basis for the sup- 

port of public education is being 

given much serious attention at 
the present time. During prosperous 
years the educational program has 
been considered of sufficient basic im- 
portance that requests for support by 
the educational administrators have 
been approved without unusual public 
attention to the financial factors in- 
volved. At the present time, however, 
the marked reduction in annual in- 
come and sources of revenue has re- 
sulted in a very critical attitude con- 
cerning educational expenditures. The 
topie under discussion, therefore, is 
one which merits careful analysis and 
evaluation in order that effective tech- 
niques may be applied in estimating 
and evaluating the financial problems 
of school administration. 

Some of the primary factors in con- 
sidering problems of educational fi- 
nance are 

(1.) The definition of the measur- 
able units in the field of educational 
finance and 

(2.) The application of measure- 
ment techniques to the analysis and 
interpretation of financial data. 


Measurable Units. 

@ne of the most frequent sources of 
error in financial studies is the com- 
parison of variable units. Frequently 
comparisons are made between groups 


of data which are not of a similar defi- 
nition. For example, in school statis- 
tics it is a frequent error that teacher 
load determined by use of enrollment 
is compared with teacher load deter- 
mined by use of average daily attend- 
ance. There is an expected difference 
of 5 per cent or more in the results 
obtained by the use of these two 
measures. 

Some of the most frequently used 
units will illustrate difficulties in 
measurement of educational finance: 


1. Cost per pupil in average daily 
attendance. 

Teacher unit. 

School district. 

Tax rate. 

Assessed valuation. 
Expenditure classifications, such 
as general control, teachers’ sal- 
aries, operation of plant, ete. 


Sot go 


Cost per pupil in average daily at- 
tendance would appear to be a rela- 
tively stable unit as it represents pupil 
days in attendance throughout the - 
school year. Many studies have failed 
to take into account the fact that aver- 
age daily attendance is determined by 
dividing the total attendance through- 
out the school year by the number of 
days taught. In other words, the 
school district operating 190 days 
might have the same average daily 
attendance as another district operat- 
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ing 170 days. The additional twenty 
days taught will result in an increased 
cost per pupil although this is not 
shown by data ordinarily published in 
connection with cost per pupil. To 
make this illustration more definite 
the following illustration will be of 
interest : 


School Days Cost Correction to 


taught per pupil 170 days 
A 195 $106.50 $92.85 
B 170 102.25 102.25 


For purposes of educational finance, 
a teacher unit may be defined as 35 
pupils or a fraction thereof in aver- 
age daily attendance.! This term in 
itself is a variable factor of consider- 
able consequence in smaller districts. 
For example, a school of 30 pupils in 
average daily attendance has one 
teacher unit, whereas a school with 40 
pupils in average daily attendance has 
two teacher units. It appears that 
this measure may be used satisfac- 
torily only in larger school districts 
where the error involved will be a neg- 
ligible factor. 

Teacher load is a somewhat similar 
term and is variously defined. In 
some studies it will include total pupil 
contacts per week, including home 
rooms and study periods. Frequently 
teacher load for schools with 45 min- 
ute periods are directly compared with 
schools with teacher loads for 60 min- 
ute periods. 

School districts are probably the 
most frequently used unit of measure- 
ment in educational finance. Expen- 
ditures and pupil costs are computed 
for annual reports on the basis of such 
district groups. A comparison of the 
expenditures of two districts should 
take into account both the size of the 
district, the length of the school year, 

i California School Code, section 4, 770 ff. 


and special conditions which may haye 
a bearing on the districts under eop. 
sideration, such as unusual transporte. 
tion charges. 

Many studies of educational finanee 
are dealing with the matter of school 
costs in which the total school expen. 
ditures broken down into the custom. 
ary headings of general control, teach- 
ers’ salaries, other expenses of instrue- 
tion, library, operation of plant, main- 
tenance of plant, fixed charges, trans. 
portation, and auxiliary expenditures, 
Some of the difficulties attendant upon 
the comparisons of historical data, 
data for different districts and partieu- 
larly for districts in different counties 
and states, are the classification of ex- 
penditure items under the general 
ledger headings. These frequently 
change year by year and depend toa 
considerable extent upon the interpre 
tation of the auditors or bookkeepers 


who are posting the accounts. 


At the present time tax rates are 
subjects of considerable discussion, 
Presumably the tax bill received by 
the property owner, which specifies a 
given rate per hundred dollars of as 
sessed valuation, would appear to be 
definite, specific, and unquestionable. 
However, for purposes of research and 
comparative statistics, there are a vari- 
ety of factors involved. Among these 
are the following: The total tax rate 
consists of a number of separate rates 
for various purposes. Even the total 
for-schools rate, which is a part of the 
total tax rate in Los Angeles County, 
consists of eight items. These rates 
are as follows: 


A. Elementary. 


1. General County Elementary. 
2. District Elementary. 
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3. Elementary Building. 
4. Elementary Bonds. 


B. Secondary. 
5. General County High School. 
6. District High. 
7. High School Bonds. 


(. Junior College. 
8. Junior College Tuition. 

For purposes of research, it is neces- 
sary that tax rates be broken down into 
the specific purpose for which they are 
intended, and any discussion of this 
particular matter is more or less in- 
valid if the persons concerned do not 
have basic information. For example, 
an apparent increase in the cost for 
schools for a certain school district in 
which the rate for 1931 was $2.76 per 
$100 assessed valuation and for 1932 
was $3.02, the increase, which was 
attributed to costs of schools, was 
really due to a change in the bond 
rate from .36 to .78 which more than 
accounted for the increase. 


Another factor of unusual signifi- 
cance in the comparison of tax rates 
are assessed valuations. The basis of 
assessment varies from county to coun- 
ty and state to state. Even though the 
ratio of assessed valuation to true val- 
uation is presumably constant in a 
given county, there are significant 
changes in valuations in given school 
districts from year to year. For ex- 
ample, a comparison of the assessed 
valuations of two extreme instances for 
the years 1931 and 1932 shows that in 
one instance the assessed valuation in- 
creased 55.7 per cent and in the other 
instance the assessed valuation de- 
creased 49.0 per cent. The average 
(median) decrease for Los Angeles 
County for 1932 was 19.5 per cent. 
As the tax rate is determined by divid- 


MEASUREMENT IN EDUCATIONAL FINANCE 


401 


ing the authorized request for revenue 
by the assessed valuation, it is obvious 
that the ratio of assessed valuation to 
true wealth and also the changes which 
are occurring from year to year are 
factors of consequence in making com- 
parable measurements in this field. 

At this point it should be mentioned 
that the customary unit of measure- 
ment in all financial matters, namely, 
the dollar, is itself a variable quantity 
in terms of its purchasing power. 
Commodity prices and index numbers 
in this respect indicate the necessity 
of evaluating our original data, ratios, 
and costs in terms of some basic cri- 
teria such as the purchasing power of 
the dollar at a given time, for ex- 
ample, the year 1913. 


Measurement Techniques. 


Statistical method provides measures 
of central tendency, variability, and 
relationship. Each of these measures 
is applicable to the study of problems 
of educational finance. In determin- 
ing the trend or most characteristic 
situation, the mean, median, or mode 
is most frequently used in the analy- 
sis of the data under investigation. 
These measures are particularly use- 
ful in showing changes in time and 
significant differences in the compari- 
son of groups. 

Measures of variability are equally 
important. Variation is ordinarily 
shown by presenting data in tabular 
form or it may be indicated by giving 
range, percentile ranks, standard devi- 
ation or quartile deviation. In case 
large numbers of instances are under 
consideration, the latter measures are 
necessary for interpretation of data. 

These measurement devices are ap- 
plicable to the study of problems of 
educational finance. They will assist 
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in establishing standards or norms for 
various sizes and types of districts. 
For illustration, the following table 
presents data for the expenditure item 
“operation of plant” for three groups 
of school districts. 

Such information based on an analy- 
sis of an adequate sampling is essen- 
tial for establishing minimum stand- 
ards and in providing a basis for ex- 
penditure control. 

Despite the difficulties confronting 
research workers in securing educa- 
tional finance data based on constant 
and clearly defined units, the impera- 
tive need of accurate and adequate in- 
formation is evident. A considerable 
part of the administrative difficulties 
in financing a satisfactory program of 
education is due to a lack of informa- 
tion of sufficient validity to command 
respect. Undoubtedly, the numerous 
studies now in progress will result in 


the development of measures 4nq 

standards which will give the much 

needed definition and objectivity t 

educational finance. 

EXPENDITURE PER PUPIL IN 1931.39 
FOR OPERATION OF PLANT 


2-5 Teacher 6 Teacher 


Schools Schools to 
Districts 599A DA 


Low* Aver- Low Aver 
age* age 


$6.67 $10.45 $5.84 $7.19 


Janitors and Engi- 
neers’ Salaries 
Supplies for Oper- 


ation 0.95 1.29 0.73 09% 
Fuel and Heat 1.02 1.20 0.62 087 
Light 0.42 0.67 0.26 O55 
Water 0.00 0.00 0.24 O43 
Miscellaneous 1.90 0.89 0.00 10 
Total per pupil 10.96 14.50 7.69 1097 
Number of Districts 28 ' 34 


*For purposes of this tabulation, “Low’ 
is the 25 percentile district or that district 
which is located at the point which divides 
the lower one-fourth from the upper three- 
fourths of the districts in the group. The 
“Average” is the median or middle district, 
The data are for Los Angeles County School 
Districts. 


THE BARRIER 


Usually I’m content 

With this, my chosen task ; 
But sometimes, as today, 

I feel the unspoken arrogance 
Of Youth toward Age. 


Their young eyes say,— 
What their lips will not utter: 
How can you enter 
Into our surging life? 


How can you understand 
The impulses that govern 
And the needs that urge? 
Your many words 

Are foolish in our ears. 


And so I know 
Between us looms,— 
Dark and impenetrable, 
The barrier of the years. 


—Racnuet L. DITHRIDGE, 
Hollis, Long Island. 
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MEASUREMENT IN DETERMINING THE 
PERSONALITY AND BEHAVIOR OF 
THE COLLEGE CRIBBER 
Witiiuam G. CamMpBeLi 
UNIVERSITY OF SOUTHERN CALIFORNIA 


Professor Campbell shows that cribbing is widely prevalent in large classes, due not 
only to the pressure exerted for high marks, but also to the ease with which cheating 
could be accomplished. 


URING the spring of 1931, an 
D extensive study of student hon- 
esty was conducted at one of the 

large state universities in the South. 
Since no previous large-scale study of 
the personality of the college cribber 
had been made, it was thought desir- 
able to gather data regarding the per- 
sonality traits of the subjects whose 
actions in various situations were being 
investigated. One of the studies in 
this field which has been reported was 
that by Brownell.'. He analyzed the 
test ratings of thirty uncaught college 
cribbers, and found that fairly defi- 
nite groups of traits were common to 
the majority. His numbers were 
small, however, and only a limited 
number of test ratings were available. 


In order to insure a fair sampling 
of the undergraduate student body and 
some range in faculty-student relation- 
ships, six classes were chosen from the 
departments of Educational Psychol- 
ogy and History of Education. Al- 
though in no case was the composition 
of the class limited rigidly to students 
of a given stage of scholastic advance- 
ment, two of the classes were designed 
primarily for students at the freshman 
level, two for students at the sopho- 
more level, and two for advanced and 
graduate students. The numbers of 


TABLE I 


RELATIVE COMPOSITION OF THE 
GROUP WITH RESPECT TO CLASS 


AND SEX 

Class Men Women Total 
Freshman 23 38 61 
Sophomore 3 36 39 
Junior 12 33 45 
Senior 3 13 16 
Graduate 6 6 12 

Total 47 126 173 


students of each sex in each college 
year may be seen in Table I. Al- 
though the numbers of seniors and 
graduates were not extremely large, 
there was a sufficient number at each 
of the other levels to insure reason- 
able reliability for the experimental 
findings. 

The spy system. The appelation of 
“cribber” was given to those students 
who were observed cheating on one or 
more course examinations, or who, 
when quizzed regarding their actions, 
admitted having done so. The remain- 
der of the students in the group were 
classed as “non-cribbers,” despite the 
fact that under other circumstances 
they might have been found guilty. 

The cheating during regular exami- 
nations was detected by advanced stu- 
dents who acted as spies. A pre-ar- 
ranged order of seating placed these 
spies at vantage points, and the small 
number of subjects (from six to nine) 


1 H. C. Brownell, “Mental test traits of college cribbers,’’ School and Society, 27: 764, 1928. 
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assigned to each spy permitted careful 
cbservations of the actions of each sub- 
ject. A student was not accused of 
cheating unless he used specially pre- 
pared notes, a notebook, or a textbook, 
or unless he asked another subject a 
question and received an answer which 
would be of aid to him. In this latter 
case, both question and answer had to 
be overheard by the spy in order to 
count against the student. Since none 
cther than these clear-cut evidences of 
procuring information from _ illegiti- 
mate sources were scored against a 
student, it is reasonable to assume that 
the figures concerning the cheating 
which occurred during examinations 
are conservative. Looking on another 
student’s paper, since the spy could 
not be certain that aid had been re- 
ceived, was not counted as cribbing. 
Many of the students who were not 
charged with cheating but who later 
admitted it had used this method to 
procure information. 

One of the most staggering figures 
brought to light by the experiment 
was that relative to the incidence of 
cheating in the university where the 
study was conducted. Of the one hun- 
dred seventy-three subjects in the ex- 
perimental group, ninety-six, or 56 
per cent, were guilty of cheating on 
one or more university examinations. 
Only seventy-seven of the subjects, or 
44 per cent of the group, were not 
charged with dishonesty. These are 





staggering figures, but they seem to be 
verified by other results. of the study, 

The personality of the cribber. The 
Bernreuter Personality Inventory was 
used as the instrument to secure g 
measure of the personality traits of 
the reagents. The blanks were passed 
to the students and they were allowed 
ample time to reply to the many items 
which comprise the test. This test gives 
a measure of the following person- 
ality traits: neurotic tendency, dom- 
inance-submission, introversion-extro- 
version, and self-sufficiency. To the 
extent that this tool measures thege 


TABLE II 


COMPARISON OF CHEATERS AND NON. 
CHEATERS ON PERSONALITY TRAITS 


Non- Observed 

Factor Cheaters Cheaters Not 
Admitted 

Bi-N score —30.34 —41.79 —393 
2—S score — 01 +16.26 + 127 
B3-I score —15.27 —21.27 —226 
B4-D score +35.67 +32.75 +29.6 


factors, it is believed that accurate re- 
sults were obtained. No effort was 
made to create a situation for measur 
ing ethical conduct in connection with 
this portion of the experiment. 

The cheaters were decidedly more 
neurotic than the non-cheaters, the dif- 
ferences in their scores being 11.45 + 
5.2 points. Although this finding is 
not extremely reliable, it is large 
enough to be considered significant. 
Furthermore, this is exactly what 
would be expected of those who crib 


TABLE IIT 
COMPARISON OF CHEATERS AND NON-CHEATERS ON VARIOUS FACTORS 
Observed 
Factor Cheaters Non-Cheaters Not Admitted 
Number of cases ......005..c000. 96 7 21 
edi dawinendsestas teens 19.59+ .31 21.05 + .38 20.00 + .49 
University grades .............. 2.944 .16 3.534 .10 2.05+ .14 
I i 5.55 06's 010 tele ecieee 3.14+ .06 3.53 + .10 3.144 17 
ED kk.s cccdcocecces 42.27 + .56 45.13 + .72 37.48 + .08 
Percentage of overstatement .... 4212+ 3.8 30.82 + 3. 53.16 + 2.6 
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on examinations, for, by definition, 
they are the ones who lean on others 
and who are somewhat deficient in 
emotional stability. In the matter of 
self-sufficiency, as measured by the 
Bernreuter Inventory, the exact re- 
verse of the above results was found. 
Those who had procured illegitimate 
aid on examinations were far less self- 
sufficient than those who had not done 
so. The difference in this case was 
16.25 + 4.1 points, and was statisti- 
eally reliable. When the other person- 
ality traits were considered, the differ- 
ences were not found to be large, but 
the cribbers were found to be more 
introverted and more dominant than 
the non-cribbers. In all of these re- 
sults, the mere size of the figures is 
not the only important factor; the 
abnormality of the groupings is worthy 
of further comment. Ordinarily, 
those who are neurotic and introverted 
are not dominant, and those who are 
dominant are usually self-sufficient. 
The fact that normal combinations 
were not found in the case of those 
who were guilty of unethical conduct 
may be offered as a partial explanation 
for their actions. 


The overstatement of the cribber. 


The information overstatement test 
was constructed according to the pat- 
tern of a multiple-choice examination. 
On the first form of the test, the stu- 
dent was asked merely to indicate 
with respect to each item the degree 
of certainty he felt in his ability to 
answer it correctly. A three-point rat- 
ing scheme was used, two points being 
given a question by the subject if he 
was certain that he knew the answer; 
one point, if he believed that he knew 


the answer but was not certain; and a 
zero score if he did not know the 
answer. The following are samples of 
the questions on this section of the 
test : 

Do you know in which one of the four 
following years the Civil War began? 
1848 1860 1861 1865 ...... 

Do you know which one of the four fol- 
lowing metals a magnet attracts? 
brass iron copper aluminum ...... 
The second part of the test consisted 

of questions of the multiple-choice 
type on which the student was expected 
to show whether or not he actually 
knew what in the first part of the test 
he claimed to know. The following 
are sample questions of this portion of 
the examination: 

The Civil War began in 
1848 1860 1861 1865 

A magnet attracts 
brass iron copper aluminum 
This presentation of the questions 

in exactly the same form in the two 

parts of the examination represented 
an improvement over Raubenheimer’s? 
technique, for with this procedure 
there could be no doubt in the sub- 
ject’s mind regarding what informa- 
tion was referred to by the experimen- 
ter. Moreover, in order to determine 
roughly to what extent a student might 
be unaware of his ignorance and mis- 
information, a control group was em- 
ployed. The students in this group, 
in addition to being given the usual 
instructions, were informed that they 
would be called upon to demonstrate 
the information which they claimed 
to possess. Since, however, it was ob- 
viously impossible to be certain in any 
one case whether or not an individual’s 
assertations regarding the possession 


2 A. S. Raubenheimer, “An experimental study of some behavior traits in the potentially 
delinquent boy,” Psy. Monog., 34, No. 6, 1925, pp. 1-107. 
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of information he really did not have 
were intentional misrepresentations, 
no individual accusations were made. 
The data have been massed and reli- 
ance placed on such trends as compari- 
sons between the groups of cribbers 
and non-cribbers revealed. The “per- 
centage of overstatement” scores, used 
in Table III, were obtained by sub- 
tracting the average score made by the 
group on the performance test from 
the average score of the certainty esti- 
mates and dividing the difference by 
the performance-test average. 

The scores for percentage of over- 
statement for the cribbers and non- 
cribbers were markedly different — 
42.12 and 30.82, the difference being 
11.30 + 5.1. This is a fairly reliable 
difference, and it indicates that those 
who were guilty of cheating were 
prone to overestimate the extent of 
their knowledge. There is a _possi- 
bility that these students actually be- 
lieved that they possessed certain in- 
formation, and, when they discovered 
their deficiency, they tried to cover 
their short-comings in any possible 
way. Both of these percentages are 
somewhat smaller than those Rauben- 
heimer® found when he gave his test 
to elementary school children of supe- 
rior moral quality, but the changed 
technique, which offered fewer oppor- 
tunities for misinterpretation than his 
did, probably explains this difference. 
Furthermore, other factors, such as 
age, experience, and knowledge may 
have influenced the results of the two 
experiments in such a manner as to 
prevent fair comparisons from being 
made. In the special group, those who 
cheated but did not admit it, the per- 
centage of overstatement was very 

3 A. S. Raubenheimer, op. cit. 
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large — 53.16 + 2.6. This ig 
twice as great as that for the nop 
cheaters, and three times as great gs 
that for the control group. Appar 
ently these two forms of misconduet 
increase in a more or less constant 
ratio, and will be found together fre. 
quently. 

The self-scoring of papers. The 
Otis Self-Administering Test of Men- 
tal Ability, Advanced Form A, with 
a twenty-minute time limit, was used 
not only to furnish an additional situs- 
tion for testing deceit but to 
intelligence-test ratings. Following 
the procedure used by Yepsen,* the 
blanks were collected at the end of the 
allotted period, and an accurate record 
was made of each student’s responses 
before the paper was returned to him 
for grading—a technique which made 
possible the detection of any subse 
quent alteration of a paper by a sub 
ject. In order to shed some light on 
the rdle of accidental errors in the 
marking and scoring of these tests, the 
control group was again employed. 
The students in this group were told, 
before the self-grading of the papers 
was begun, that an accurate copy of 
their papers had been made. Sinee, 
however, an earnest appeal for accu 
racy had been made to the experimen- 
tal group, it is questionable whether 
the motivation for accuracy in scoring 
was any greater in the control group 
than in the experimental group. In 
any case, actual changes made by a 
student while scoring his paper would 
constitute unethical behavior. 

Cheating on the Otis Test occurred 
among 45 per cent of those subjects 
who had an opportunity to score their 
papers. Twelve students were absent 


4 L. N. Yepsen, “The reliability of self-scored measures,” School and Society, 26: 657-660, 1927. 
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when this scoring took place, and, of 
this number, ten had been guilty of 
cheating on course examinations, 
whereas only two had not been so 

. Although somewhat less than 
one-half of the students were guilty of 
changing their Otis Test scores, this 
ol not divided equally be- 
tween cribbers and non-cribbers. Of 
seventy-two who did modify their pa- 
pers, forty-four, or 61 per cent, be 
longed to the group of cribbers, while 
only twenty-eight, or 31 per cent, of 
those who did not change their work 
had been guilty of cheating on course 
examinations. It should be remem- 
bered in connection with the former 
group that ten of the twelve students 
who were absent when the _ scor- 
ing was done had cheated on course 
examinations, and that this figure 
might easily have been increased mate- 
rially had all students been present. 
It was found, in another portion of 
the experimental work, that those who 
were frequently absent from class were 
often found to be guilty of cheating 
when examinations were given. 

There were reliable differences be- 
tween the Otis test scores of the crib- 
bers and the non-cribbers, the former 
having a mean score of 42.27, the lat- 
ter a mean score of 45.13, the differ- 
ence being 2.86 + .89 points. This 
shows clearly that, on the average, 
those who cheated were below the men- 
tal level of those who did not cheat. 
Furthermore, the difference in Otis 
test scores for those who did and those 
who did not alter their papers was 
6.70 + .84 points. Here, again, it 
will be noted that those who were 
guilty were significantly less able men- 
tally than those who were not guilty 
of unethical actions. There is reason 


to believe that a portion of the person-- 
ality of the individual, both his atti- 
tudes and his actions, is the result of 
his native endowment. 


In all cases except those of the regu- 
lar examinations, where the spies were 
used, assurance was given the groups 
that their performance of the task at 
hand would have no influence upon 
any university marks or standings. 
In all instances the students seemed 
ignorant of the real purpose of the 
experimental technique, and they re- 
acted spontaneously. 

In the matter of scholastic achieve- 
ment, those who were found to have 
cheated were well below the level of 
those who were not guilty. Reference 
to Table III will disclose the fact that 
the difference in the mean university 
grades for the two groups was .59 + 
.11 grade points. Furthermore, the 
mean course grade difference (this 
was the grade earned by the student 
in the class where he was observed 
cheating) was .39 + .10 grade points. 
It should be remembered, moreover, 
that a portion of this latter grade was 
earned by dishonest means. Both of 
these differences are very reliable, and 
both are decidedly against the cheater. 
When it is recalled that the cheaters 
were, as a group, below the mental 
level of the non-cheaters, it is only rea- 
sonable to assume that a portion of the 
pressure to which these students were 
subjected was the result of deficient 
native endowment. 

The non-admitted cribbers. One of 
the most interesting comparisons made 
was that of the subjects who were ob- 
served cheating and who would not 
admit it with the rest of the group. 
Most of the subjects were quite frank 
in their admissions of dishonesty, but 
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there were twenty-one who denied be- 
ing guilty, even when they had been 
observed in their misdeeds. In every 
comparison, these subjects appeared at 
a disadvantage when compared with 
the honest students, or even with the 
dishonest students who admitted their 
guilt. 

The percentage of overstatement for 
this group was 53.16, or 22.34 + 4.4 
per cent more than the honest group. 
This is a very striking and reliable 
difference. Moreover, the mean intel- 
ligence test score for this group was 
7.65 + .74 points below that for the 
non-cribbers. This is a very great dif- 
ference, being more than one and one- 
half standard deviations below the 
mean for the group as a whole. When 
the mean university grades were com- 
pared, it was found that this distinctly 
dishonest group had a_ grade-point 
average of only 2.05, as compared with 
a grade-point average for the non- 
cribbers of 3.53. This difference rep- 
resents the difference between grades 
of “D” and “B-” on the normal grade 
curve. That this difference was of 
great importance cannot be doubted. 
The comparison between the mean 
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course grades for the two groups did 
not reveal such striking diffe 
but it must be remembered that at 
least a portion of the grade in this 
course was earned dishonestly, 

The difference was only .39 + .10, 
but even this was extremely reliable, 
The tendency for this group to appear 
at a disadvantage in every comparison 
was very striking. 

Summary. (1) Dishonest conduet, 
both minor and gross, occurred fre 
quently among the students at a large 
state university. (2) The combing 
tions of personality traits branded the 
cheater as a more or less distinctive 
entity, since the normal groupings of 
scores, according to the Bernreuter In- 
ventory, were not found among this 
group. (3) All degrees of dishonesty 
appeared among the individuals stud- 
ied —a fact which suggests that the 
categorizing of people into honest and 
dishonest is not justified. (4) The 
incidence of cheating in the classes 
under observation was a function of 
the pressure exerted by relevant fae- 
tors and the ease with which misrepre- 
sentation could be accomplished. 
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DANGERS AND VALUES IN TEACHER-MADE TESTS 


D. Werty Lerever 


ASSOCIATE PROFESSOR OF EDUCATION 
UNIVERSITY OF SOUTHERN CALIFORNIA 


There is far more to test making than having them objective. Does the test diagnose 

teaching and learning difficulties? Does it enforce correct teaching practices? Does 

it differentiate between those who know the subject and those who are clever in 

guessing? Professor Lefever points nee Bh difficulties, but he also shows how to 
avo em. 


HE construction and use of ob- 

jective tests is growing out of its 

adolescence and is coming of age. 
The novelty has worn off. Objective 
tests are no longer feared as an inven- 
tion of the devil with which to mecha- 
nize the pupil’s thinking and to thwart 
originality. They are no longer con- 
sidered a panacea for all the ills of 
ineffective instruction. The testing 
movement is rapidly leaving the fad 
stage when teachers and administrators 
gave tests in order to be considered 
progressive and when little came of 
the testing except files of record cards, 
and a few neat looking charts in the 
superintendent’s annual report. The 
present period is characterized by a 
sane and thoughtful recognition of 
serious limitations in the use of tests 
accompanied by an appreciation of 
important values. 

So many problems are encountered 
in constructing homemade objective 
tests, and many of the difficulties in- 
volved are so easily unnoticed that a 
periodic review of the main problems 
and difficulties is valuable. The pres- 
ent article will attempt to bring to at- 
tention a few of the difficulties and 
dangers to be kept in mind in con- 
structing teacher-made tests. 

The number of items in a test 
which actually contribute to the capac- 
ity of the test to differentiate the mem- 


bers of a class into several levels of 
ability may be surprisingly small. 
Just because a test is apparently com- 
posed of one hundred questions or 
exercises is not proof that such a num- 
ber of items enters into the measure- 
ment of pupil ability. If sixty items 
are so simple or well known that the 
group is practically unanimous in 
answering them correctly, the test in 
reality consists of only forty items. 
The writer was told of a course in 
which only one test was given. This 
test consisted of twenty questions of 
which eighteen were answered cor- 
rectly by almost every one in the class. 
The marks for the course were based 
on two questions, not twenty. 
Undoubtedly, serving as a basis for 
marks is not the most important use 
for a test, but obviously as long as 
marks are given, they should be as 
accurate as possible. Marks that are 
fair and just can result only when the 
class has been accurately divided into 
several levels of achievement or ability. 
Reliable differentiation is unlikely to 
occur unless there is a fairly large 
number of separate items assisting in 
the measurement of the range of abil- 
ity in the group. If a considerable 
number of these items are too easy or 
too difficult, the measuring value of 
the test will be seriously impaired. A 
wise practice in this connection is to 
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keep tab on the number of pupils 
answering each item correctly. In this 
manner the difficulty of each question 
can be discovered. 

It is important to balance a test 
with respect to the difficulty of the 
items composing the test. This means 
that if the questions or exercises are 
placed on a scale of difficulty as deter- 
mined by the number of correct re- 
sponses there will be only a few very 
difficult questions and only a few ex- 
tremely easy questions. Most of the 
items will be of average difficulty. A 
test containing too many easy or too 
many difficult questions is likely to 
result in a badly distorted or skewed 
distribution of scores. If one test is 
properly balanced in difficulty for a 
highly selected graduate class in the 
university and if another test is bal- 
anced with respect to a high school 
freshmen group of the same size, the 
scores from the graduate group will 
approximate a normal curve as closely 
as will the scores made by the high 
school freshmen. A symmetrical dis- 
tribution of scores means that the 
marks based upon such a distribution 
are more likely to be fair and true 
than if a badly skewed distribution 
were employed. 

The major argument offered in fa- 
vor of the new type test is that the 
scoring is more objective than when 
the traditional examination is used. A 
new type test may, however, appear 
to be more objective than it really is. 
This is a difficulty frequently over- 
looked. For example, a true-false test 
after the scoring key is once deter- 
mined may be considered perfectly 
objective in the sense that a hundred 
scorers using the key would give the 
same test paper identically the same 
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score. There may, however, be oon. 
siderable disagreement among 

as to the correctness of the key. Qp 
going back into the construction of the 
test there may easily be argument over 
the wording of the items. Questions 
may arise regarding emphasis, choice 
of modifiers, the presence of specific 
determiners and the like which may 
cast considerable doubt on the fing) 
score. Still more disagreement could 
easily be found among the experts 
concerning the choice of items and the 
general make-up of the test. 


The lack of agreement on the part 
of experts over the construction of a 
test would undoubtedly be much 
greater in certain fields than in others. 
Mathematics and science tests, in gen- 
eral, would probably result in less dif- 
ference of opinion while in fields like 
sociology and education it is difficult 
to find many questions not purely fac 
tual or obvious in nature concerning 
which there would be complete agree 
ment. In new fields of study like edv- 
cation and sociology, much of the ob 
jectivity of the objective-type tests is 
really a sort of “frozen subjectivity.” 
The real test of objectivity is substan- 
tial agreement among those qualified 
to judge and not the mechanical appli- 
cation of a scoring key. 

A valid objective test is one care- 
fully constructed so that the emphasis 
given the items in the test will reflect 
accurately the emphasis received by 
the corresponding topics in the course. 
Otherwise the test is not measuring 
achievement in the course. Debatable 
questions will be eliminated at least 
in so far as they may directly affect 
the score. Ambiguous wording will be 
avoided. Instead, direct and simple 
statements will be used. No catch or 
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trick questions will ever be inserted 
to trip the unwary because that will 
make the test a measure of a rather 
shallow sort of cleverness rather than 
of achievement in the subject field. 

One of the most difficult problems 
in test construction is that of steering 
the test between the Scylla of obvious 
questions on well-drilled subjects on 
the one hand, and the Charybdis of 
unimportant and equivocal questions 
on the other. If the important facts 
and principles of the subject have been 
given proper emphasis during the 
course most of the class should be able 
to answer correctly questions concern- 
ing them. This will result in few 
questions effectively measuring the 
range of ability in the group. On the 
other hand if the teacher searches in 
out-of-the-way corners of the textbook 
for obscure and unimportant items of 
knowledge, the student will be re- 
warded who memorizes his work in 
parrot-like fashion without distinguish- 
ing between the wheat and the chaff. 
Quite obviously a solution to the diffi- 
eulty is the construction of questions 
requiring the student to exhibit in 
practical application a mastery of the 
principles concerned. These questions, 
in general, are more difficult to invent 
and may not always lend themselves 
readily to objective form. The writer 
believes that some considerable thought 
and practice given to the construction 
of this type of question will result in 
more effective examinations. 

One rather valid objection to the 
more extensive sampling characteristic 
of the objective-type test is the empha- 
sis usually placed on memory and 
purely factual information. Test 
items requiring of the student a 
i recognition of surface facts are 


much easier to construct than those of 
any other type. For example, if com- 
pletion questions are to be employed 
the temptation is to take key sentences 
from the text and to omit a number 
cf words from each sentence. Unless 
one is very careful in the process 
words will be omitted in such positions 
in the sentence as to require the stu- 
dent to have memorized the wording 
of the text in order to answer the item 
correctly. Completion questions should 
demand of the student only a definite 
knowledge of the subject matter and 
neither the ability to recall verbatim 
portions of the text nor unusual clever- 
ness at cross-word puzzles. 


True-false tests are frequently guil- 
ty of skimming the surface of a sub- 
ject. If a true-false question attempts 
to deal with more fundamental prob- 
lems in many subject fields it is very 
likely to encounter controversy. An 
exercise in judgment for the student 
will undoubtedly have real value but 
it is questionable whether he should 
be penalized for answering a debatable 
question in a manner opposite to the 
point of view of the instructor. 

The way in which tests are given 
and the character of the emphasis 
placed upon them by the teacher will 
determine to a large extent the study 
procedure likely to be followed by the 
student. Tests emphasizing the memo- 
rization of large quantities of subject- 
matter will tend to produce the par- 
rot-type student who constitutes a 
large portion of our school population 
at the present time. Tests present- 


ing problems requiring independent 
thought and reasoning based on the 
important principles of the subject 
will reward the thoughtful student and 
should stimulate genuine scholarship. 
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One problem in the mechanics of 
test organization and administration 
with which the teacher will have to 
deal is that of controlling the time ele- 
ment in the test. For most purposes 
the test should undoubtedly be of the 
power type, which means that a gen- 
erous time allowance will be given the 
student. If the time set is too short 
the student will be forced to hurry 
over questions that should require 
eareful thought and judgment. In 
this connection, the writer believes 
that the practice of dictating true- 
false questions is likely to be at fault. 
Unless the question is very simple and 
is presented in an unusually direct 
manner and unless it concerns itself 
merely with matters of information, 
there is danger that the student will 
not be able to give it sufficient atten- 
tion to reply in a manner adequately 
representing his mastery of the sub- 
ject. Students have frequently com- 
plained, and perhaps with justice, that 
so much of their attention was re- 
quired to understand the wording of 
the question, that they did not have 
the opportunity to present their best 
thought on the question before being 
compelled to attempt the next item. 


Teacher-made tests need not con- 
sist entirely of the so-called objective 
form for there is still value to be 
gained from the use of carefully pre- 
pared examinations of the subjective 
type. Some of the difficulties to be 
overcome in the organization of a well- 
planned essay-type examination are: 
(1) making the test questions clear 
and definite, so that the student knows 
whether to write a word, a sentence, 
or a short essay in response to the 
question, (2) employing questions 
which will compel the student to do 
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independent thinking, (3) constr 
ing the test so that it will constitut, 
a reasonably extensive sample of the 
subject matter, (4) constructing y 
schedule of points to be covered in g 
complete answer to each question, g 
that the scoring can be much mor 
definite and more reliable. The brief 
answer form of test has many of the 
advantages of both the old and new 
style examination. Its tendency is to 
require complete recall and not merely 
recognition as is the case with so many 
of the objective test forms. It is flex. 
ible and may be used to probe some 
what more deeply than surface infor. 
mation. 

In spite of the difficulties and prob 
lems likely to be encountered in the 
construction of teacher-made tests, 
there are distinct values to be derived 
therefrom, as compared with the ex- 
clusive use of ready-made, standard 
ized tests. The standardized examina- 
tion seldom fits the course of study as 
organized in any particular school, and 
almost never emphasizes topics in the 
same manner as the instructor. If the 
ise of standardized tests throughout 
the school is organized by the adminis 
tration for the purpose of rating 
teachers, a great deal of harm is likely 
to result. Even where there is no 
formal attempt at rating, teachers may 
come to feel that their effectiveness is 
being judged on the basis of standard 
ized tests which imperfectly match the 
work done in the classroom. The re 
sult is likely to be a tendency to teach 
to the test. If the results of the stand- 
ardized test, as applied to the whole 
group rather than to the individual 
student, are taken too seriously, the 
outcome may be a tendency to stand- 
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ardize instruction and to prevent that 
constant adaptation of methods and 
materials which is the hall-mark of 
good teaching. Standardized tests, 
when employed as a basis for diagnos- 
ing pupil difficulties and when used by 
the teacher as a personal check on the 
effectiveness of instruction, become 
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without question one of the most use- 
ful tools in teaching. The teacher- 
made test is probably of still greater 
value because of its flexibility, its 
closer approximation to the work of 
‘of the class, and because of its vital 
and personal relationship to the think- 


ing of the teacher and the student. 


HOW TO STUDY FOR OBJECTIVE TESTS 


C. C. Crawrorp 


PROFESSOR OF EDUCATION 
UNIVERSITY OF SOUTHERN CALIFORNIA 


Cramming for subjective examinations means gathering together the tests used by 

an instructor with former classes and memorizing the answers to all the questions. 

Can one study effectively for the new type form of tests? There are many students 
who would like to know the answer. 


TUDENTS often ask, and usually 
in vain, for practical suggestions 
on how to prepare for true-false, 

completion, or other objective tests. 
They say they have learned how to 
study for the old-style essay test, but 
that the new tests present a new prob- 
lem in study technique for which they 
are unprepared. 

As a result of many such requests 
for help or advice from students, the 
writer has undertaken to assemble a 
few tentative suggestions. Thirty 
graduate students in a course on 
“Methods in Directed Study” were 
asked to submit any ideas they 
had acquired on this subject, either 
through personal experience or read- 
ing, and the best of their contributions 
are summarized in this article. 

First will be presented general prin- 
ciples and policies that apply to study- 
ing for objective tests of whatever 
type, after which will follow more spe- 
cifie suggestions for the major kinds 
of objective tests. 


I. Generat PRINCIPLES AND 
Po.uicres 


The objective type of test, as a type, 
differs from the essay type in its de- 
mands upon the student, and the fol- 
lowing suggestions may help the stu- 
dent to meet its peculiar requirements : 

1. Take the objective test seriously. 
There is a common notion that it is 
easy, that guessing will yield a fair 
number of correct answers, and that 
if one question is missed, it does not 
matter because there are many others. 
The fact is that the test is as easy for 
other students as for oneself, and 
that a difference of one or two right 
answers may change the mark mate- 
rially. 

2. Study by extensive methods in- 
stead of or in addition to intensive 
methods. The objective test samples 
knowledge in a multitude of places 
instead of delving deeply into only a 
few topics. Furthermore, it demands 
somewhat more of the recognition 


+ 2- > oeraesers 











414 


rather than of the recall response. 
This fact suggests the wisdom of be- 
ing acquainted with a large number of 
aspects of the subject or course, even 
if lightly and superficially, rather 
than devoting too much time to a few 
topics. The soundness of this doctrine 
of extensive sampling is somewhat in 
doubt, we must admit, and deserves 
further investigation. 

3. Review for the test by skim- 
ming over the high points. The rea- 
son for this policy is that instructors 
often make up their tests by turning 
the pages and hitting the “mountain 
peaks” of the subject; hence the stu- 
dent’s need for something of the same 
process in matching his mind with the 
instructor’s. 


4. Watch for key words, dates, 
proper names, and other highly con- 
crete, factual, or objective items. The 
demand for objectivity of scoring 
causes a teacher to gravitate naturally 
toward this type of questions, even 
though he realizes that he should test 
thought, appreciation, or other intan- 
gible products. 


5. Study the individual instructor's 
peculiarities and testing habits. Some 
test makers stress facts, others opin- 
ions. Some select major points, others 
include more minor details. Experi- 
enced test makers have fewer trick 
questions or misleading items. Expe- 
rience with an instructor may tell 
whether to answer a question as it is 
written or whether to look at it with 
suspicion to see where the catch or 
joker lies. 

6. Make up imaginary test items 
beforehand. The student’s selection 
and statement of items may not match 
the instructor’s very closely; yet the 
effort to do so will bring about the 
formation of many of the same bonds 
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as will be required for the instructors 
test. The plan of students gj 
each other objective tests is co 
reported, and those who have tried it 
seem convinced of its effectiveness, 

7. Study any available test ques 
tions on the subject. Tests used for 
previous classes, tests given by other 
instructors, or tests printed in books 
study guides, ete., upon the subject, 
all give help and guidance. Two testy 
may not have a single item e 
identical; and yet each will probably 
stress somewhat the same fundamen- 
tal issues. 

8. Read about the theory of objec- 
tive test construction. The instructor 
is the fisherman and the student the 
fish, as it were. From the standpoint 
of the fish it would be advantageous 
for each fish to read a good treatise on 
the fisherman’s technique in order to 
avoid being caught. It would at least 
be interesting if someone would com- 
pare objective test scores of students 
who have had such instruction with 
those of students who have not. 


II. Sprcrric Procepures anp Porr 


cles For TRUE-FALSE TEsTs 

The true-false test statement, by its 
very nature, has an individuality of 
its own. The following suggestions 
were compiled as contributions to 
study technique for this type of test. 

1. Hunt for debatable issues. The 
test maker is likely to choose issues 
which are fairly close or debatable, 
rather than those which are obviously 
true or obviously false. Popular su- 
perstitions, common misconceptions, 
and points upon which the man in the 
street differs from the scientist oF 
scholar are especially likely to be 
used for true-false items. 

2. Get the viewpoint of the author 
or instructor. Since the test is to be 
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scored in the light of the source from 
which it is drawn, the student must 
know which side of a debatable issue 
the author or instructor takes. He 
may disagree with either or both, but 
ean at least answer the test accord- 
ing to the book or teacher. A true- 
false test paper is a poor place to in- 
sist upon one’s own views when they 
are in conflict with those of the au- 
thorities on the subject. 

3. Check the book or notes very 
carefully for positive, emphatic, epi- 
grammatic, or startling statements. 
The instructor is likely to select test 
items from this type of points instead 
of resorting to more prosaic or com- 
monplace issues, because they catch 
his attention when he turns the pages 
hunting for likely questions, and also 
because they are already practically 
ready-made true-false items. 

4. Note especially the exceptions 
to general rules and principles. The 
test maker often wishes to test knowl- 
edge of a fundamental point which if 
stated as such would perhaps be too 
easy; hence in order to make it into 
a valid true-false item he “slips up 
on it from behind” by introducing 
one of the exceptions. 

5. Get the fundamental viewpoint 
or philosophy of the subject. The 
specific statement is often apparently 
trivial or unimportant in itself but is 
included because it illustrates or re- 
lates to something much more funda- 
mental. Students sometimes get the 
idea that true-false tests do not 
amount to much, and hence do not 
study effectively for them, because of 
this failure to recognize fundamentals 
behind examples or test cases. 


6. Note any specific clues in the 
wording of the statements. Such 
words as always, never, everyone, no 
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one, etc., furnish valuable clues sug- 
gesting false statements, while words 
like often, usually, or generally, 
soften a harsh statement down and 
make it much more likely to be true. 
An expert on test construction, G. M. 
Ruch, has found that one can mate- 
rially improve his score on a typical 
true-false test on an unfamiliar sub- 
ject by noting such special words, 
which he calls “specific determiners.” 
7. Avoid extremes of doubt and 
suspicion. The fact that some state- 
ments are false does not mean that 
all are tricky, misleading, and inten- 
tionally deceptive. Some instructors, 
it is true, resort to trickery and decep- 
tion because they have not yet become 
expert in test construction, but most 
tests are plain, straight, square, hon- 
est, and above board. The student 
who suspects an ambush at every turn 
is likely to do worse than the one who 
reacts to each statement as if it really 
meant what it appeared to mean. 


III. Spectric Procepurgs anp Pott- 
cries ror Comptetion TEsts 


The completion test does not have 
a very distinct study technique, so far 
as could be determined in this investi- 
gation, but such tentative suggestions 
as could be collected are presented in 
the next few paragraphs. 

1. Study to recall rather than 
merely to recognize points. The true- 
false test is a mere recognition test, 
but a completion test requires a more 
thorough mastery. It is well, there- 
fore, to test oneself for ability to 
name the points that are likely to be 
asked, if the test is to be of the com- 
pletion type. 

2. Memorize any available lists or 
outlines of points. A common tend- 
ency of test makers is to formulate 
questions that call for enumeration of 
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the subdivisions of an outline, or that 
call for supplying the general category 
in which a specific subpoint falls. Any 
definite list or outline should there- 
fore receive extra attention. 

3. Specialize on new words or 
technical terms. A word that is pecu- 
liar to a restricted subject or topic 
makes an unusually good basis for a 
completion test, since its meaning can 
be stated as a test item and the word 
itself left blank for the student to fill 
in. A student who has a good record 
in completion tests reports that he 
underlines all new words as he reads, 
and later gives them a very special 
review. 

4. Concentrate on definitions, laws, 
dates, and other highly definite items. 
The difficulty of scoring completion 
tests with a high degree of objectivity 
leads the test maker to select a large 
percentage of his items from the “dry 
bones” of knowledge and memory 
rather than from the less tangible 
products requiring thought and judge- 
ment. Names and places may not be 
as important as principles and con- 
cepts, but they are more easily scored. 


TV. Specrric Procepures anv Pott- 
cries For Matcuine TEsts AND 
Best Answer TESTS 


The sources from which suggestions 
were drawn in this study seemed not 
to be very fertile with respect to study 
techniques for the matching and best 
answer tests. Mention was made of 
the importance of understanding im- 
portant terms, of hunting for any natu- 
ral pairs of points, such as cause and 
effect or men and events, and of get- 
ting a real mastery of important con- 
cepts and principles so that their rela- 
tionships to other items could be read- 
ily recognized. Since matching tests 
very often measure a recognition of 
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the part-whole type of relationship, jt 
is suggested that considerable effort hy 
made to get a rich fund of detail 
associative content to go with each 
major point, principle, or 

The best answer test is psychologically 
about the same as the matching test, 
in fact a simplified form of matehi 
since answering requires the selection 
of one item from several and i 
it agree with the original statement, 


V. Some Fryar Consiperations 


The meagerness of the offering pre 
sented here suggests either that there 
is little that students can do to im- 
prove their scores in objective tests 
through the study techniques em- 
ployed, or else that if there are many 
really helpful methods of work, few 
students have discovered them. Per 
haps the difficulty here encountered in 
our efforts to formulate study helps 
for students in taking objective tests 
points to a needed extension of the 
efforts of the test and measurements 
experts. 

Perhaps, on the other hand, the 
fact that students know so little about 
how to “beat the game” in taking ob 
jective tests is cause for congratula- 
tion. Perhaps it is just as well that 
we leave them in ignorance of the fine 
tricks of the test taker’s profession, 
and let their papers reveal knowledge 
of the subject matter of the courses 
taken rather than knowledge of the 
clever tricks of getting a better mark 
than they deserve. At least, some pro 
fessors see the situation this way, and 
perhaps they are right. At least, if 
students are to be coached in methods 
of taking tests, the coaching should be 
made available for all instead of for 
just a few who get it through “boot 
leg” channels. 
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SOME RESULTS OF THE TESTING MOVEMENT 


J. Harotp WrixiaMs 


PROFESSOR OF 


EDUCATION 


UNIVERSITY OF CALIFORNIA AT LOS ANGELES 


Too long has education been dominated by theories which have not been valid. Meas- 
urement has shown how to improve teaching practices and methods of organization. 
It has been a determining factor in curriculum revision and adjustment of the pro- 
to meet individual differences. It is probably not an over-statement to assert 

that measurement is as important in education as accounting is in business. 


ucation Association in 1897 Dr. 

J. M. Rice suggested that spell- 
ing ability in children might properly 
be measured by giving them a list of 
fifty selected words and counting the 
number correctly spelled. It had 
been his chief purpose to discuss the 
relative merits of different methods 
of teaching; but his suggestion of a 
plan of objective measurement, with 
more or less standardized procedure, 
was a new idea, and one which has 
been of profound influence in educa- 
tion. 

There was ample precedent, at the 
time of Dr. Rice’s experiment, for 
applying objective methods in the sys- 
tematic study of facts. Progress in 
other fields of human endeavor, nota- 
bly the physical sciences, had been 
made in almost exact proportion to the 
extent to which measurement methods 
had been made available. The mak- 
ing of measurements still occupies the 
time of many workers in every sci- 
ence. Evaluation is a part of com- 
plete observation. 

There was also precedent for the 
protests which arose from some educa- 
tors against any attempt to measure 
educational results, or to express such 
results numerically. The early scien- 
tists, seeking more exact methods of 
observing and evaluating natural phe- 
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A T a meeting of the National Ed- 


nomena, were obliged,to meet opposi- 
tion of the same sort. The fear was 
expressed that measurement was too 
materialistic; that it was an undigni- 
fied procedure, unbecoming persons 
who were capable of reflective think- 
ing; and that the examination of fac- 
tual data might divert the mind from 
more important philosophical consid- 
erations. But the subsequent develop- 
ment of astronomy, physics, and chem- 
istry seems to have justified the objec- 
tive approach. Today the leading 
concepts of world structure are based 
upon evidence obtained from measure- 
ments; and in education such proce- 
dures have been among the most effee- 
tive means of improving instruction 
and school organization. 

Educational measurements compare 
favorably with physical measurements 
in their applicability and relative ac- 
curacy. Thorndike has pointed out 
that certain physical standards, such 
as absolute zero, are of very recent de- 
termination; and that courts of law 
make important decisions involving 
the use of physical units which are no 
better established than are many of 
those in regular use in connection 
with the interpretation of standard 
educational tests. 

Improved teaching methods have 
followed closely upon the testing 
movement. Although successful teach- 
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ers have always known that learning 
depends to a certain extent upon intel- 
lectual development, it is only since 
standardized tests have become avail- 
able that the relationship could be ob- 
served or utilized in a practical way. 
Children who under older practices 
might have been given up as being un- 
able to learn, but who are shown by 
intelligence tests to have mental ca- 
pacity beyond their present achieve- 
ment, may safely be encouraged and 
expected to do better. On the other 
hand, children of limited mental ca- 
pacity, who under traditional systems 
might be prodded to the extent of dis- 
couragement, may now be assigned 
programs within their mental grasp, 
and credited with achievement which 
is normal for them. Without the use 
of measurements extending beyond 
the scope of ordinary class-room obser- 
vations such adjustments are not easi- 
ly made. Probably some of our best 
teaching is accomplished in this way 
with segregated groups of children 
from the extremes of the distribution 
curve; the subnormal and the gifted. 
The normal child also has better op- 
portunities in the school in which test 
results are regularly applied. 


The principle that school achieve- 
ment can be measured in definite 
units, and in the light of norms, has 
given instruction an impetus which 
was much needed. School surveys re- 
peatedly pointed out that schools and 
school systems differed from each 
other greatly in their accomplish- 
ments, even with similar time allot- 
ments; and that these differences were 
often due to the failure of some schools 
to make use of available standards of 
achievement. The deviations were not 
all on the negative side. Some schools 
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were actually achieving more than way 
necessary or desirable in certain gy} 
ject matter fields, while neglecting 
important activities. In these age 
the systematic use of tests has beg 
recommended as an economy measure 
Not only standard tests, but new 
type tests of all kinds came into ym 
when it became evident that improved 
examination methods tend to produge 
better instruction. Thinking teacher 
saw in this method an opportunity t 
eliminate much of the guess-work that 
had characterized their previous ef- 
forts. School systems not only made 
regular testing a part of the school 
procedure, but also embarked upon 
programs of test construction, with 
the establishment of local norms t 
accord with their own curricula 
needs. In many cities this work has 
been carried on with great care and 
accuracy. It has become concrete evi- 
dence of an earnest desire on the part — 
of school officials to conduct their 
schools efficiently. : 
In the promotion of pupils the con 
sideration of test results has become 
a common practice. This is partir 
larly true where promotion means 
transfer to another school, as from 
elementary to junior high school, or 
from junior to senior high school 
Even when traditional grading sys 
tems are retained, it has been deemed 
wise to distribute marks in such & 
manner as to avoid great deviations 
from test findings. This has been 
especially desirable where school marks 
are interpreted as evidence of ability 
to pursue a course of higher educr 
tion. Secondary schools now feel this 
responsibility more keenly than ever. 
Most of: the recent improvements ia 
marking systems are based upon ev 
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dence secured from test results. These 

s usually include the use of 
standardized procedures, and the elimi- 
nation of the subjective element in 
judging abilities and accomplishments. 
It seems probable that the whole prob- 
lem of issuing grades and marks will 
come in for some serious discussion 
during the next few years, and mea- 
surements will be found necessary to 
such considerations. 

Test results are especially useful in 
the study of plans for curriculum re- 
vision. Although occasionally the fear 
is expressed that formal testing may 
in some way bring about too rigid ad- 
herence to traditional subject-matter, 
it appears that in reality the opposite 
effect is being produced. Test con- 
struction leads to a better evaluation 
of teaching aims and objectives. Cur- 
riculum revision has been most active 
during the. testing era, and has been 
greatly stimulated by measurement in- 
vestigations. These two types of re- 
search have often gone hand in hand 
as their interdependence has been rec- 
ognized. Some of the most signifi- 
cant changes in curricula have been 
brought about in school systems in 
which measurement facilities were 
available for checking the results of 
curriculum experiments. It does not 
accord with the spirit of this scientific 
age for anyone to claim that progress 
has been made in a given direction 
without producing some objective evi- 
dence of the asserted change; and 
most curriculum makers have shown 
a disposition to avoid such errors. 
Experiments with the activity pro- 
gram, for example, have included the 
use of standard tests in the traditional 
subject-matter fields, with the subse- 
quent finding that the newer plan of 
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organization contributes fully as much 
to achievement in these subjects as 
any other plan of instruction. Other 
experiments have shown that some 
methods of teaching are about twice as 
effective as others, as judged by rela- 
tive achievement. Without test re- 
sults such claims would rest upon very 
uncertain ground. For purposes of 
this sort standard tests furnish one of 
the most reliable forms of evidence. 


The more intensive study of the 
curriculum has made it necessary to 
state the objectives and methods of 
education, at least for practical pur- 
poses of school organization, in more 
definite form than has been the prac- 
tice of former years. The test move- 
ment has contributed to this purpose 
a terminology which the schools have 
been quick to adopt. Such terms as 
mental age, I. Q., subject age, 
norm, prognosis, correlation, grade- 
placement, validity, reliability, T- 
score, occur in educational discussion 
without the necessity of special expla- 
nation. At the same time certain 
other words and expressions which are 
not new to education have taken on 
new and more definite meanings, in 
consequence of their use in testing 
programs. Among the latter are such 
words as achievement, development, 
guidance, distribution, survey, gifted, 
accelerated, retarded, maturity, homo- 
geneous, capacity, tabulation. 

Tests have contributed more than 
any other method of observation to 
the study of individual differences. 
To give every child an education 
suited to his capacity is an aim which 
could hardly be realized without the 
use of objective tests. Beginning 
with the segregation of retarded and 
subnormal children the differentiation 
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of instruction has reached the point 
of complete ability grouping in some 
schools. Although practical diffieul- 
ties have been encountered in making 
such a plan work in schools which 
have long been organized on a tradi- 
tional basis, the success obtained in 
some schools has aroused much inter- 
est and discussion. There is little 
tendency, in all of the opposition to 
ability grouping, to refute the conten- 
tion that learning is most efficiently 
accomplished in a situation appropri- 
ately gauged to the ability of the 
learner. If homogeneity is not pos- 
sible in all classes, schools have under- 
taken to determine where it can be 
obtained, and under what conditions 
it is most effective. Test findings play 
an important part in the study of the 
problem. 

The measurement program of to- 
day’s school is not a haphazard utiliza- 
tion of experimental tests. It is a 
carefully planned procedure, usually 
directed by a well-trained person, and 
will be found to contain a balanced 
diet of selected standardized tests, the 
validity and reliability of which have 
been established. It includes the use 
of a series of achievement tests, ap- 
propriately fitted to the curriculum 
and local needs, and suitable tests of 
intelligence, aptitude, interests, and 
emotional stability. The extent of 
the program depends partly upon the 
funds available, and these are being 
wisely spent; it also depends partly 
upon the attitude of the school admin- 
istration toward the use of objective 
methods, and the encouragement given 
teachers for their practical applica- 
tion. Under such a program every 
child in the school system will have 
the benefit of measured results. 
Teachers will have something definite 
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to supplement their own opinions jg 
matters of promotion and grading: 
parents may have more confidenee ix 
the work of the schools, because of 
the elimination, in part, of the gy} 
jective elements which too often infly. 
ence school reports. Administrative 
officers may feel more secure in the 
use of results obtained by test proce 
dure, for there is no part of the school 
system which is based upon sounder 
investigation. The single fact that 
such results make possible the com. 
parison of one school system with an- 
other justifies the use of standard 
tests. 

The school of the future may be 
characterized by a _ child-centered, 
naturally-motivated, activity program; 
it may be even more rigid and me 
chanical in some respects than are the 
schools of today; it may be both of 
these. In any event it appears self- 
evident that there will be an increas 
ing need for developmental facts, ob 
tained by reliable methods of observa- 
tion; there will be more need than 
ever for methods of measuring what 
is being accomplished. Enlightened 
parents will seek more information 
about what the schools are doing, and 
what changes are being brought about 
in their children. Taxpayers may de 
mand from the schools an accounting 
of results, in terms of objective stand 
ards which will be intelligible to the 
layman. All of these require not only 
the application of what has been 
learned with the use of tests, but the 
making of more and better tests. It 
is inconceivable, in the light of te 
cent progress, that education should 
be again dominated by theories which 
are not supported by objective evr 
dence. 
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THE EFFECTS OF REST PERIODS ON PROGRESS IN 
LEARNING IN TYPEWRITING 


A. S. RausENHEIMER and S. H. Davipson 
UNIVERSITY OF SOUTHERN CALIFORNIA 


The authors find scientifically what most teachers have generally felt to be true, that 

interruptions in the learning process are detrimental. They also find, what many 

teachers who assign heavy amounts of home work need to have brought to their 

attention, that in typewriting at least, irregular, unsupervised work in the beginning 
stages of learning is definitely detrimental to progress. 


F educational efficiency is to be 
attained, the effect of recesses upon 
the learning process along with 

other factors must be ascertained. 
Data bearing upon improvement or 
deterioration of the stimulus-response 
bonds after recesses are very limited 
in quantity. Those experiments which 
have been performed have dealt with 
a few selected pupils and have been 
conducted under the carefully con- 
trolled, yet artificial, conditions of the 
laboratory. More experimentation, 
therefore, is needed, and, in particu- 
lar, carefully conducted experimenta- 
tion in specific fields in the practical 
circumstance of the classroom. 

Statement of the problem. The 
problem of this study may be stated 
as follows: 

1. It aims to determine to what 
extent, if any, speed of typewriting is 
increased or decreased by rest periods, 
varying in length from two to four- 
teen days. 

2. It aims to determine to what 
extent, if any, accuracy of typewriting 
is increased or decreased by rest peri- 
ods, varying in length from two to 
fourteen days. 

Related investigations. The bulk of 
the evidence pertinent to the deteriora- 
tion or improvement of stimulus-re- 
sponse bonds following periods of dis- 
use has been compiled by Thorndike 
in his Educational Psychology, Vol- 
ume IIT. Thorndike asserts that, in 
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general, periods of disuse are followed 
by a weakening of the stimulus-re- 
sponse bonds and that, other factors 
being equal, this weakening is propor- 
tional to the length of the period of 
disuse. Of the experimental studies 
summarized by Thorndike, two are 
pertinent to the present investigation : 

1. Book reports a study in which 
Individual A was tested for ability in 
typewriting after long periods of dis- 
use. “A” averaged 1508 strokes and 
2.21 per cent error in ten 10-minute 
tests from January 7-16, 1906. After 
a long rest period he was retested from 
June 1-10, 1906, averaging 1433 
strokes and 3.54 per cent error. Af- 
ter a still longer rest period, he was 
tested daily from June 1 until June 
10, 1907 and averaged 1611 strokes 
and 3.15 per cent error. 

2. Rejall used himself as a sub- 
ject in studying the permanence of 
ability to typewrite. At the end of 30 
hours of practice, he could type 25 
words per minute with 4 errors per 
hundred words. After a rest period 
of 34 years, he made the following 
scores on the first five days: 

18.7 words per minute with 8 errors 
per hundred words. 

18.9 words per minute with 714 er- 
rors per hundred words. 

21 words per minute with 6% er- 
rors per hundred words. 

22.1 words per minute with 5 errors 
per hundred words. 
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22.5 words per minute with 824 er- 
rors per hundred words. 

By continuing the practice he re- 
gained in five additional hours of prac- 
tice nearly the same efficiency that he 
had obtained in 30 hours, three and 
one-half years before. 

Other experiments summarized by 
Thorndike involved the effect of peri- 
ods of disuse on such mental functions 
as (1) memorization of nonsense syl- 
lables (Ebbinghaus and Rasossawljew- 
itsch), (2) ball tossing (Swift), (3) 
multiplication (White) and (4) addi- 
tion (Kirby). As Thorndike himself 
states “the only facts that they display 
with any unanimity and brilliancy are 
the apparent complexity and variabil- 
ity of deterioration by disuse and our 
lack of knowledge about it.” 
Procedure. 


1. The subjects used in this study 
were pupils in regular typewriting 
classes at the Huntington Beach 
Union High School during the school 
year 1928-29. Seventy-five students 
enrolled with the same teacher in three 
sections of first-year work were in- 


cluded. 


2. All of the first-year students 
were given regular classroom instruc- 
tion in accordance with the Weise- 
Coover System of teaching typewrit- 
ing. The daily period was 55 minutes 
long. 

3. The first-year students were 
given daily 15-minute speed tests, be- 
ginning October 15. Test material 
was selected from the Wiese-Coover 
text, “Kinesthetic Method of Touch 
Typewriting” and from test material 
prepared by various typewriter manu- 
facturers. 

4. Exact records of test results for 
each student were kept, the following 





items being recorded: number of test, 
date of test, gross number of words 
typed, number of errors, net number 
of words after deducting ten for each 
error, gross rate of strokes and the net 
number of words per minute. The 
records were kept on “Pupil’s 
Record Sheet” forms, provided by the 
H. M. Rowe Company, for use jg 
schools using the Wiese-Coover method, 
5. Tests given before and after the 
following rest periods were carefully 
studied for decreases or increases ip 
speed and accuracy: 
October 20-21—Two days 
October 27-28—Two days 
November 3-4—Two days 
November 17-18—Two days 
November 24-25—Two days 
December 8-9—Two days 
December 15-16—Two days 
November 10-12—Three days 
November 27-— 
December 2—Six days 
December 19-January 1— Fourteen 
days 
6. Since it would be impossible to 
require that all pupils refrain from 
practice during rest periods unless 
they were told of the study and its 
purposes and since it was thought that 
such knowledge might cause an unnat- 
ural strain during tests given before 
and after rest periods, it was decided 
that all students should turn in prac 
tice slips showing the number of mit- 
utes spent in practice each day. These 
slips were required from all students, 
but it was made clear that outside 
practice was not a requirement. Such 
slips were initialed by the parents. 
Analysis of results. Comparisons 
were made of average gross 
number of errors, per cents of error, 
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and net speeds before and after rest 
periods. 

The average gross speed was 274.5 
words per 15 minutes before the two- 
day rest periods and 275.3 words per 
15 minutes after these periods; the 
average gain in gross speed being only 
‘8 word. The increase of 178 words 
in gross speed obtained in the 33 
learning periods between October 20 
and December 17 represents an aver- 
age gain of 5.4 gross words per learn- 
ing period. Thus the average gain in 
gross speed over a two-day rest period 
is only one-sixth as great as the aver- 
age gain for the normal learning peri- 
od. After the three-day rest period 
there was observed an average loss of 
18 words in gross speed; after the six- 
day rest period there was a 2-word 
average increase; the fourteen-day 
period was followed by a 10-word 
average decrease. 

Following the two-day rest periods, 
testing revealed an average decrease 
of .5 errors. There was an average 
increase of 1.9 errors after the three- 
day rest period, of 4.4 errors follow- 
ing the six-day rest period, and of 9.7 
errors following the fourteen-day rest 
period. 

There is a decrease in the average 
per cent of error following the two- 
day rest period, from 3.3 to 3.1 per 
cent. After the three-day rest period 
it increases from 3.0 to 3.9 per cent, 
after the six-day rest period from 3.3 
to 4.7 per cent, and after the fourteen- 
day rest period from 2.6 to 4.2 per 
cent. 

A consideration of average net 
speeds revealed that there was a gain 
of 8.2 words following the two-day 
rest periods. This gain is consider- 
ably in excess of the average gain of 
4.4 words in a normal learning period. 
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Following the three-day rest period 


there was an average loss of 33 net 
words, following the six-day rest peri- 
od an average loss of 42 net words, and 
following the fourteen-day rest period 
an average loss of 60 words. 

Table I gives the average number 
of gross words, average number of er- 
rors, average per cent of error, and 
average number of net words before 
and after rest periods. 

On studying the records of those 
pupils who engaged in irregular, un- 
supervised typing practice during the 
rest periods, that is, at home over 
week-ends, it was found that by far 
the majority showed losses both as to 
speed and accuracy. 

Conclusions. The study seems to 
justify the following conclusions: 

1. All rest periods which are at 
least two days in length tend to retard 
progress in the learning of typewrit- 
ing as measured by gross speed; the 
retardation in gross speed increases 
with length of the rest period. 

2. Following a two-day rest period 
there is a slight improvement in accu- 
racy; following longer rest periods 
there is a loss in accuracy, the loss 
increasing with the length of the rest 
period. 

3. The two-day rest period may be 
considered beneficial to the learning 
process since the increase in net speed 
indicates that the improvement in 
accuracy more than offsets the retarda- 
tion in gross speed. 

4. Rest periods of greater length 
are detrimental to learning since there 
is a retardation in both speed and 
accuracy. 

5. Irregular and unsupervised type- 
writing by pupils in the beginning 
stages of learning is definitely detri- 
mental to progress in learning. 
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NEEDED DEVELOPMENTS IN MEASUREMENT 
FOR SECONDARY SCHOOLS 


J. Murray Lee 
DIRECTOR OF RESEARCH, BURBANK, CALIFORNIA 


The fifteen years that have passed since standardized objective testing was first intro. 
duced into the secondary school have shown mainly how much more needs to be done, 
It is still virgin territory and many a doctor's dissertation will be found here. 


HAT are the next steps in the 
\ \ program of tests and measure- 
ment for secondary schools? 
Occasionally in any work it is neces- 
sary to take inventory and project 
plans for the future. Standardized 
testing in the high school began about 
1916.1 Since that time tests have 
been published in increasing numbers 
until now there are over 610 tests? 
commercially available for use in the 
secondary schools. According to the 
best estimate available there were over 
6,000,000 standardized intelligence 
and achievement tests used in the sec- 
ondary schools during 1931. It is 
not the purpose of this article to evalu- 
ate this movement or to show trends* 
but to set forth needed developments 
as suggested by public school workers, 
namely, high school principals and 
research directors. 


The material which is included has 
been gathered from two sources. The 
first source was the incidental com- 
ments appearing on a questionnaire to 
high school principals requesting in- 
formation concerning testing practices 
in their schools. Replies were re- 
ceived from nearly 500 schools repre- 
senting all forty-eight states. The sec- 
ond source was from a check list which 
was filled out by 106 research depart- 


ments from all parts of the United 
States. Among other data the check 
list requested the changes which the 
directors would suggest in their own 
department and a statement of what 
they felt were the most needed devel- 
opments in the field of testing for see. 
ondary schools. In analyzing these 
data there has been no attempt to show 
the relative importance of each prob 
lem discussed. The purpose has been 
to present the thinking of persons in 
the field who are dealing with the 
actual situation and in their own 
words whenever possible. It is felt 
that such a treatment is much more 
valuable than presenting the thinking 
of one person in this field. 


OPINIONS OF ADMINISTRATORS 


While there was no definite question 
on the check list to high school prin- 
cipals as to needed developments, many 
interesting comments appeared on the 
check lists. These comments when 
summarized seem to offer valuable 
material when considering needs in 
this field. 

The most outstanding problem, as 
might be expected in this period of 
decreased budgets, was the lack of 
funds and also personnel. Some of 
the statements bring this out very 
clearly. 


1 J. Murray Lee, ‘““‘Testing Programs for Secondary Schools.” An unpublished doctor's dis- 
—— on file in the Teacher’s College Library, 1932, Chapter II. 
Ibid 


3 Ibid., Chapter I. 


4 David Segal, ‘“‘Trends in Tests,’’ School Life, Vol. XVIII, Oct., 1932. 
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“Due to lack of funds, no tests will 
be given this year. Results could be used 
to a greater advantage if adequate ad- 
ministration and supervisory personnel 
were available.” 

“We have no program because of lack 
of funds. Principal does what he can 
with no Board of Education support.” 

“Qur system makes no allowance for 
time or help in testing. Cost and extra 
time allowances have been our largest 
handicaps.” 

“We have no testing since the depres- 
sion hit us.” 

Another statement reflecting the 
favorable situation when trained per- 
sonnel is available follows. 


“We are just commencing to use our 
test results in guidance, since we now 
have counselors who are able to use 
them.” 

Several of the schools, including the 
one just quoted, were just beginning 
to use tests or to desire them. 


“The program in this school is just 
being organized and present methods are 
somewhat confused. A complete educa- 
tional, physical, and personality study, 
as well as a social history, will eventu- 
ally be available for all children in the 
school.” 

“Very little testing has been done in 
the high school. We are planning, hop- 
ing to do more.” 


One principal from a large city, 
having a research department, writes: 

“No testing program has yet been es- 
tablished in the school. I am not satis- 
fied with the situation.” 

Expressing an opposite point of 
view, another says: 

“I wish we might have more real 
teaching and less effort spent in petty 
testing. We have junked most of our 
testing program and I think we are 
ahead because of it.” 

Other statements stress the use of 
teacher-made tests. 


“The tests are planned here in the 


departments and changes are made each 
year to meet the needs of the curriculum. 

. . I find that an imposed program 
of testing does not arouse the same sup- 
port that is given one worked out by 
the teachers interested.” 

“We are doing quite a good deal of 
studying and developing teacher-made 
comprehensive tests.” 

“We have had teachers from each 
school in the city plan tests for the en- 
tire city. In this case there was stimu. 
lated considerable interest.” 


Another trend indicated was away 
from the use of intelligence tests. 
Some of these statements were most 
interesting. 


“We use the achievement test exclu- 
sively. It correlates very closely with 
the so-called intelligence test and it has 
not its implications.” 

“Our use of tests is not what it should 
be, due to the fact that our Board of 
Education has ruled against the use of 
intelligence tests throughout the system. 
We find that percentile ranks on a read- 
ing examination give us a fair substi- 
tute for the intelligence test score.” 

“We are not very strong for intelli- 
gence tests. A good achievement test 
will show everything that an intelligence 
test is supposed to show.” 


And finally from one principal 
comes :— 

“T find mental tests utterly unreliable 
as given. Unseasoned people try to de- 
termine infinite questions with finite 
means and fail, as they should. Am ab- 
solutely disgusted with the propaganda 
of psychic mountebanks. They are re- 
verting back to the system of thought 
that the school men used in the middle 
ages.” 

These quotations should be consid- 
ered as each representing only one 
opinion. They do, however, illustrate 
the extreme feeling at both ends of 
the scale on testing and indicate sev- 
eral needs of the secondary school. 
These needs are: 1. Money for the 
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purchase of tests. 2. Trained person- 
nel to handle the testing programs. 
3. Teacher-made tests which will mea- 
sure the outcomes of instruction. 4. 
Principals with more knowledge of 
modern testing. 


NEEDED IMPROVEMENTS IN ORGAN- 
IZATION IS EXPRESSED BY 
Researcu Drrecrors 


Most of the directors did not reply 
to the question concerning the needed 
changes in the organization of their 
department or made the statement 
that present conditions were satisfac- 
tory. From the 20 percent which sug- 
gested changes, several significant 
trends are apparent. 

First, an improvement in the use 
of test results by the teachers. 

Second, the need of more work in 
the actual construction of tests. 

Third, an enlargement of the work 
on the secondary level. 

Fourth, a program for the improve- 
ment of teachers in their ability to 
make good tests. 

Fifth, greater cooperation and in- 
terest on the part of teachers and prin- 
cipals. 


NeEEepED DEvELOPMENTs IN THE FIELD 
or Sreconpary Scuoot TEsTInG As 
Expressep spy Researcu Directors 


There were thirty-four different 
items mentioned as being the most 
needed developments in the field of 
testing in the secondary schools. The 
largest number mentioning any single 
item was ten. This offers an indication 
that there is not one single problem 
which is pressing but a rather large 
number. Frequency of mention is not 
to be taken as an index of importance 
for probably the replies were given 
very quickly and they had no list of 
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problems to guide them. The list does 
contain a large number of p 
which are in need of further congi. 
eration by research workers in genergl 
and does give an idea of the type of 
problems which research directors fg] 
need solutions. 


Better Tests—Better tests are neei- 
ed. The suggestions for improvement 
which were given were, that tests 
should be more reliable, have 5 or ¢ 
forms, be shorter and be more thor 
oughly standardized. Short tests 
which are reliable must cover a fairly 
limited body of subject matter, while 
more thorough standardization prob 
ably should be undertaken by the pub 
lishers. The expense of putting a test 
on the market does not lie in its pub 
lication but rather in its standardiza- 
tion. Until the publishers are willing, 
to a greater extent than they have been, 
to assume part of this burden, better 
standardization of tests is difficult. 
Needless to say, the responsibility goes 
back to the purchaser to insist upon 
adequate standardization. 


Training of teachers— The com- 
ments stressed need for teachers to be 
better trained in the use of tests, in 
making valid tests, in a better under 
standing of what tests reveal, and in 
their values in different situations. 
The opportunity for this training has 
largely been through college work and 
a surprising per cent of the teachers 
report having had courses in measure 
ment. There would seem to be an op 
portunity here for training in serviee 
which a goodly number of research de 
partments and principals are neglect 
ing. 

Constructing new type tests — The 
emphasis was placed on the construc 
tion of tests to fit the local course of 
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study. The following quotation is 
typical : 

“More tests made in system to fit 
subject-matter or courses of study ben- 
efits teachers as well as makes better 
tests.” 

Prognosis or aptitude tests — More 
prognosis or aptitude tests are needed 
for guidance in the selection of sub- 
jects and in the discovery of special 
aptitudes. The opinion of one director 
a aivegnesis tests for guidance pur- 
poses here are one of the greatest needs.” 

Such tests are available now for Al- 
gebra, Geometry, Latin, modern for- 
eign languages, commercial subjects, 
art, music and mechanical ability. 

Outcomes other than factual—This 
field offers large opportunity for work. 
The directors desire tests which will 
“measure attainment of educational 
aims other than information” and 
“other than mere knowledge,” and 
those which “test thinking capacity as 
well as information.” One member 
of a research department states: 

“T feel that when such techniques (the 
measurement of other outcomes) can be 
developed, the whole movement for the 
improvement of measurement in second- 


ary education will go forward much more 
rapidly than it has in the past.” 


The others say that they wish: 


“A technique for testing objectives and 
outcomes other than content and factual 
knowledge,” and “a new type of test 
that measures significant relations as 
well as facts.” 

The latter “is especially needed in 
literature and social studies.” 

It seems significant that the six 
directors quoted above, are in cities 
with population above 150,000 while 
four of them are in cities larger than 
400,000. It is hoped that these di- 
rectors in the more important posi- 
tions will contribute to the solution of 
this problem. 

The remaining developments which 
are given in Table I were mentioned 
only three times or less. The items 
which are lettered were given only 
once and they are direct quotations 
from the check lists. 

This list of needed developments 
should be of value to research depart- 
ments in considering where others feel 
problems exist, to teachers of meas- 
urement courses in trying to make 
their courses more functional in solv- 
ing the problems of the field, and to 
research workers in selecting problems 
for which there is a felt need for solu- 
tion. 


TABLE I 


A LIST OF NEEDED DEVELOPMENTS IN SECONDARY SCHOOL TESTING 
AS REPORTED BY RESEARCH DIRECTORS 








Frequency 
Rank of ITEM 
Mention 
1.5 10 Better tests. 
1.5 10 Training teachers in making and using tests. 
3. a) Constructing new-type tests based on the local course of study. 
4. 8 More prognosis or aptitude tests. 
5. 6 Tests which will measure outcomes other than factual. 
8. 3 More tests. 
8. 3 More diagnostic tests, 
8. 3 Better tests for vocational guidance. 
8. 3 More reliable norms. 
8. 3 Tests based on desired outcomes of instruction. 
11.5 2 Comprehensive batteries with cOmparable scores. 
11.5 2 Diagnostic reading tests. 


| 



































EDUCATION IN 1940* 


Frank C. Tovron 


VICE-PRESIDENT OF THE UNIVERSITY OF SOUTHERN CALIFORNIA 


To one who sees school buildings erected in 1933 from plans that were obsolete many 

years ago and who finds teachers being hired on a basis of relationship to some member 

of the School Committee rather than the ability to teach, the thought comes that 

Professor Touton’s 1940 may need to be changed to a later date for some of the item 
he has included. 


Introduction 


BACKWARD look over four 

decades in education reveals 

changes and progress which no 
conservative educator of 1890 would 
have predicted. From a review of 
certain phases of this development it 
is my purpose here to mention some 
features of the educational program 
which will appear, I think, at the end 
of the present decade. 


The items considered are: growth 
in school enrollments and in the num- 
ber of teachers employed in all levels 
of instruction, preparation of the 
teaching staff, purposeful education, 
school classrooms, methods of learning, 
use of moving pictures, student activ- 
ity in the classroom, and equality of 
educational opportunity. 

Growth in School Enrollments. 
Prior to 1890 enrollment figures were 
not gathered as now by the Office of 
Education of the Department of the 
Interior. Reports earlier than 1890 
do not provide comparable data and 
are not here given. The figures given 
below are from Bulletin No. 20, 1931, 
of that Department. The predictions 
for 1940 in the several divisions are 
approximations, made with due regard 
to the trends of enrollment exhibited 


*A lecture given b 


the writer on April 16, 


for the ten-year periods, 1890 to 1930 
inclusive. Several factors are judged 
potent in determining the projected 
trend for the decade from 1930 to 
1940, among which are the restrictions 
on immigration and the lowered birth 
rate, which will certainly operate to 
decrease the rate of increase in elemen- 
tary school enrollments. The present 
general unemployment almost cer 
tainly will operate to raise the compul- 
sory age limit of school attendanee, in 
order that the places of children in 
industry may be filled by now unem- 
ployed adults. Then, too, the pres 
sure of our economic situation will re 
tard the usual rise in enrollments in 
the upper grades of the secondary 
schools and in the several levels of 
higher education, both public and pri- 
vate. The growth of professional 
school enrollments cannot be expected 
to continue at its present upward rate, 
for the professional services which 
their graduates are prepared to render 
must bear a constant ratio to the pres 
ent reduced rate of growth in the popu- 
lation unless new services are discov 
ered and trained for by professional 
schools. 

Below are given in thousands the 
school enrollments by decades since 
1890, with predictions for 1940. 


1932, at the Western Pennsylvania Educational 


Conference, Pittsburgh; and on November 28, 1932, at the University College of the University 


of Southern California. 
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(Enrollments and Predictions are Given in Thousands) 














School Level 1890 1900 1910 1920 19380 1940 
Gs. wei a-0-4 00.8 Wal bwarenaie ene 32 225 346 511 778 900 

Elementary and Kindergarten ............ 14,181 16,224 18,457 20,864 23,588 
} vane wom Pete ed sc cihg ohn awe aes S 358 696 1,111 2,495 4,800 7,000 


Normal Schools and Teachers Colleges... 
Universities and Professional 

BohOOls .....cccccecccsccccccesscccsees 

Special ee  OPTERE TELE EEE Le 

Junior Colleges (included above) .......... 


35 70 89 135 162 175 


158 168 267 462 924 1,250 
ee ee ss 500 700 
75 125 














The data on enrollments and pre- 
dictions of the above table reveal the 
following trends: 

(1) Since 1890 the kindergarten en- 
rollments have increased from 32,000 
to 778,000 in 1930 and will probably 
reach 900,000 in 1940. 

(2) Since 1890 the kindergarten 
and elementary school enrollments 
have increased from 14,181,000 to 
23,588,000 or approximately 64% and 
will probably reach 26,000,000 in 
1940. 

(3) Since 1890 the secondary school 
enrollments have increased from 358,- 
000 to 4,800,000 and will probably 
reach 7,000,000 in 1940. During the 
past forty years the secondary school 
enrollments have practically doubled 
each decade, a growth which is not 
matched by that of any other social 
institution of like magnitude anywhere 
in the world. 

(4) Since 1890 the normal school 
and teachers’ college enrollments have 
increased from 35,000 to 162,000 and 
are estimated to reach 175,000 in 
1940. 

(5) Since 1890 the enrollments in 
colleges, universities, and professional 


schools have increased from 158,000 
to 924,000. The rate of growth shows 
an increase of approximately 60% 
over each preceding decade. The en- 
rollments in the levels of higher edu- 
cation exclusive of normal schools and 
teachers’ colleges will probably reach 
1,250,000 in 1940. In all levels of 
higher education beyond the secondary 
schools, the enrollments in 1940 will 
probably approximate 1,500,000 stu- 
dents. 


Teachers in all levels of instruction. 
The data for the several decades have 
been expressed in the nearest thou- 
sands as are the estimated figures for 
the several teaching levels in 1940. 


The number of teachers, expressed 
in thousands, for the several decades 
and types of schools are given below: 

The data on the number of teachers 
for the decades 1890 to 1930 and the 
predicted enrollments of each of the 
several levels of instruction may be 
summarized as follows: 

(1) From 1890 to 1930 the number 
of teachers giving instruction in the 
kindergarten and elementary schools 
increased from 376,000 to 703,000, a 
rate of increase much higher than the 
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rate of increase in school enrollments 
in these levels. The estimated number 
of teachers for this level of instruction 
in 1940 is 750,000. 

(2) From 1890 to 1930 the num- 
ber of secondary school teachers in- 
creased from 16,000 to 238,000, a rate 
of increase which kept pace with that 
of the secondary school enrollment. 
The predicted number of secondary 
school teachers for 1940 is 300,000. 

(3) From 1900 to 1930 the number 
of teachers in normal schools and 
teachers’ colleges increased from 4,000 
to 14,000. The prediction for teachers 
in this level and type of instruction 
is 16,000 in 1940. 

(4) From 1890 to 1930 the num- 
ber of teachers in colleges, universi- 
ties, and professional schools increased 
from 13,000 to 70,000, at a rate which 
almost kept pace with the five-fold in- 
crease in enrollments in these institu- 
tions of higher learning during the 
past four decades. The predicted 
number of teachers in institutions of 
higher learning for 1940 is 85,000. 

Briefly stated, the instruction of 
students of all levels of education was 
done in 1890 for 15,000,000 students 
by 417,000 teachers; and in 1930 for 
30,000,000 students by 1,038,000 
teachers. It is here estimated that the 
task of instructing 36,000,000  stu- 
dents estimated for 1940 in the sev- 
eral levels of education will be carried 
on by 1,200,000 teachers. 

Preparation of Teaching Staff. 
Teachers who enter the profession in 
1940 will hold credentials showing 
educational training of four or more 
years beyond the secondary school. 
For teachers of elementary schools, 
both rural and urban, this period of 
training will include a curriculum of 





four years, approximately 60 per cent 
of the time will be devoted to the mas. 
tery of the humanities, the social gg. 
ences, the physical sciences, the bio 
logical sciences, English language and 
literature, practical and fine arts, with 
electives in the fields of the classical 
and modern languages, and in mathe 
matics. That forty per cent of the 
four-year program of the elementary 
school teacher which is devoted to 
fessional training will certainly in 
clude history and philosophy of edu 
cation, educational psychology and 
measurements, educational methods 
and practice teaching. The four-year 
teachers’ college program of training 
for elementary teachers will be more 
academic than now, while the training 
programs for these teachers as given 
in college and university departments 
of education will give more emphasis 
to classroom methods and techniques 
and to the theory and practice of 
teaching. 


The elementary school teacher who 
enters the profession in 1940 will be 
equipped as a four-year college gradu- 
ate with professional training. Ele 
mentary school teachers of 1940 with 
less academic and professional train 
ing than that described above will be 
rapidly displaced unless they continue 
their education to a point which ap 
proximates the four-year college pro 
gram. 

In our nation today but one state 
(California) requires of secondary 
school teachers one full year of gradu- 
ate study, 33 states require college 
graduation, and 15 states do not even 
require graduation from college in the 
equipment of those who qualify for 
teaching in secondary schools. The 
trend toward college graduation (100, 
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000 students are now graduated annu- 
ally) with the presence of schools of 
education in our leading universities 
is certain to lead state boards of edu- 
eation throughout the nation to decide 
upon a nearly uniform practice of fix- 
ing five years of academic and profes- 
sional training beyond the secondary 
school as the minimum requirement of 
secondary school teachers of academic 
subjects. 

By 1940 the junior colleges, now 
numbering 450 and enrolling 75,000 
students, will have reached an enroll- 
ment of 125,000 and will demand a 
type of teacher as well prepared in 
academic subject matter as is required 
for lower-division instructors in the 
college and university. For these 
schools, in their academic departments, 
there is certain in 1940 to be a demand 
for teachers who have professional 
training for teaching and at least two 
years of graduate study. The doctor 
of philosophy and the doctor of educa- 
tion will be found with increasing fre- 
quency in the ranks of the junior col- 
lege teachers. 


Educational literature in the college 
fields now indicates that graduate de- 
partments of some of our leading uni- 
versities are interesting themselves in 
the preparation of their doctor’s candi- 
dates for college teaching. Content is 
stressed; yet method is considered, 
though it seems to be agreed that the 
proper methods can be revealed and 
imparted only by Ph. D’s with majors 
in subject fields. Method is here rec- 
ognized as important in the equipment 
of the college teacher and a real vic- 
tory has been won; by 1940 college 
teachers will have learned many of the 
applications of educational philosophy 
and educational science to college 
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teaching. Our college teachers now at 
work will attempt to teach themselves 
improved methods while the on-coming 
generation of college teachers will se- 
cure this knowledge and training as a 
part of their graduate study and 
training. 

Soon after 1940, all elementary 
teachers will have had four years of 
college training, the typical secondary 
school teacher will have a full year of 
graduate study to his credit; the 
Junior college teacher, two years of 
graduate study; and the progressive 
college teacher will have had training 
in educational methods appropriate to 
his subject and directed practice teach- 
ing as an integral part of his prepara- 
tion for teaching. 

Purposeful Education. The teach- 
ers of yesterday taught the content in- 
cluded within the covers of the adopted 
texts. So do a majority of the teachers 
of today. The thought of one author 
in a given field almost cireumscribes 
the thinking of the pupil. Learning 
is yet too largely a mere mastery of 
fact, with little consideration of the 
purpose, or plan, or method. 

Fortunate it is that textbook writ- 
ers are beginning to give consideration 
in their texts to the purposes to be 
achieved or goals to be reached by the 
pupil through the use of the printed 
pages. A beginning only has been 
made. Of the purpose to be achieved 
by his course, not one teacher in a hun- 
dred has a clear vision. Such prog- 
ress as we have made is due largely 
to the work of Snedden, Bobbitt, Char- 
ters, and a few others. These men 
have forced certain teachers to face 
the question “Why do I teach Caesar, 
modern history, geometry, English lit- 
erature, and the like ?”’ 
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It is the opinion of the writer that 
the major purposes of the course 
should be known to the teacher, to 
guide in the instruction process, and 
to the pupil to guide him in his learn- 
ing efforts. In 1940 to a larger extent 
than now, the mastery of content, the 
directed experiences of the student all 
will contribute to the achievement of 
the known and accepted goals of the 
course, which shall mark mile posts 
passed in the development of the stu- 
dent. 


By 1940 our teachers will have 
moved far from the teaching of mere 
subjects. They will have accepted it 
as their responsibility to teach through 
directing student experiences with use- 
ful content. Teachers will realize 
more than now that mastery of sub- 
ject matter is not an end in itself, but 
simply a means of bringing about de- 
sired ends, clearly set forth in such 
language as will be understood by 
teacher and student alike. The learn- 
ing process will be participation in a 
series of activities in which each step 
has a meaning and contributes to the 
attainment of known and accepted 
objectives. 


School Classrooms in 1940. Though 
notable departures may be seen in cer- 
tain school systems, still the typical 
American school classroom has from 
30 to 40 seats of the conventional 
type, the teacher’s desk, the black- 
board, the dictionary, the nation’s 
flag, and little else. Certain writers 
in educational magazines are now 
pointing out the fact that real learn- 
ing consists in responding to stimuli 
under the direction of the teacher. 
Here the teacher shows his skill and 
resourcefulness in arranging the ele- 
ments in the school environment in 
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which the pupil lives and learns 
responding to stimuli. Obviously the 
elements which together constitute the 
environment of the classroom should 
be selected with a view to stimulati 
the type of response which is desired, 
Teachers of the sciences, and of the 
fine and practical arts have pointed the 
way. More recently teachers of clasg- 
cal and modern languages have seen 
the advantage of creating the clas. 
room environment which provokes 
thought appropriate to the subject 
taught. From several quarters come 
evidence of attempts to select and ar 
range the classroom equipment — it 
bulletin boards, its furnishings, its 
bookshelves, its draperies, its pictures, 
its blackboards, its chairs—in an effort 
to create environment appropriate to 
the learning activities which go on 
within the walls of the room. The old 
type of bare-walled classroom is sure 
to go by 1940. By then we will have 
made much progress in arranging our 
English classrooms for English think- 
ing; our history classrooms for devel- 
oping history mindedness; our mathe 
matics classrooms for thinking in quan 
titative terms with mathematical sym- 
bols. 

Methods of Learning. The efforts 
of teachers since the beginnings of for 
mal education have been centered on 
the problem of pupil achievement. 
The “Why?” of the process has only 
recently come to educational conscious 
ness, yet already gains in the direc 
tion of purposeful education have been 
observed as has been previously met 
tioned. Somehow knowledge has been 
held sacred and the gaining of it has 
been accepted as worthy of supreme 
effort. Its possession has been the de 
sired goal. The processes by which 
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the goal is to be reached or has been 
reached are given a minimum of con- 
sideration or neglected altogether. The 

ion of knowledge has been and 
still is the all-important end. 

As the writer views the matter, 
much more importance should be at- 
tached to the nature of the processes 
by which information is acquired and 
the problems solved. The particular 
fact may never occur again, and the 
problem in its present form may never 
reappear, yet other facts must be ac- 
quired and other problems must be 
solved. The mastery of method of 
work, therefore, takes on increased 
significance. The plan of work should 
be ever in the student’s consciousness. 
From day to day, from month to 
month, and from year to year, the stu- 
dent should ever be alert in carrying 
his plans to their fulfillment and in 
improving his techniques of learning. 

With our acceptance of student de- 
velopment as the goal of education, we 
are certain during the next decade to 
focus our attention on the methods 
employed by the student in gaining a 
real command of himself and in real- 
izing to the full his maximum personal 
development. 

In this connection, President von 
KleinSmid and I have collaborated in 
organizing and integrating the con- 
tributions of approximately one thou- 
sand junior and senior college teachers 
as these contributions have revealed 
important steps in the methods of 
work to be used by students in their 
attempts at the mastery of content ele- 
ments in some twenty major fields of 
study in the junior college level of 
achievement. Since the content learned 
in school is so soon or so nearly for- 
gotten, the justification of the effort 
expended must be in the mastery of 


methods used, rather than in the value 
of the facts learned. 

By 1940, we will, I think, be tak- 
ing this new view of the educational 
process. We will count our efforts 
worthy in proportion to the success of 
our efforts in developing student abili- 
ties and individual student methods in 
mastery of situations and problems, at 
least some elements of which are new 
or unfamiliar to the student. 

Use of Moving Pictures in Instruc- 
tion. Whether we wish to do so or 
not we are forced to recognize the mov- 
ing picture as a powerful educational 
agent. It may give incorrect informa- 
tion and may set up wrong standards 
of life, yet children and adults do “go 
to the movies,” and get while there a 
certain type and amount of education. 

Visual aides are provided now in 
modern schools. As yet they supple- 
ment the normal procedures rather 
than supplant them. In the laboratory 
and lecture room the moving picture 
presents in fifteen minutes the visual 
record of the life history of the plant 
or animal; in the shop the details of 
the processes of industry are revealed 
by the moving picture records; the 
football and track coach uses the mov- 
ing picture to point out the elements 
of good form and to check the accu- 
racy of field performance. 

The secondary schools will in 1940 
make a large use of films to give visual 
pictures of scenes of literature and his- 
tory, to vitalize project work of many 
types, and to exemplify types of activi- 
ty where standardization is desired. 

Student Activity in the Classroom. 
From the beginnings of formal educa- 
tion to the present, approved classroom 
procedure has been that of reciting by 
the pupil with the checking and cor- 
recting of errors by the teacher. Dur- 
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ing the decade just passed, and in the 
elementary school in particular, dar- 
ing teachers have had the courage to 
vary the usual procedure so as to give 
time to the direction of pupil activity 
in new fields of work. This plan is 
finding its way into the junior high 
school, but has not been accepted as 
an approved method in the senior 
high school or junior college. By 
1940, I think, we shall find many 
teachers in the secondary schools who 
will plan to divide the recitation peri- 
od about equally between the checking 
of students’ work and the directing of 
the thinking of students as they ap- 
proach their new assignments. Of 
course, checking of work will continue 
to be important, yet a clearer under- 
standing of the responsibility and op- 
portunities of the teacher will increas- 
ingly draw the attention of the teacher 
to the richer field of effort,—that of 
directing the thinking of students as 
they undertake their new tasks. The 
longer or sixty-minute recitation peri- 
ods in some secondary schools make it 
possible for the teachers to give some 
attention to the review of assigned 
materials and yet leave sufficient time 
to observe and direct pupils as they 
initiate their new tasks. The second- 
ary school classroom of 1940 will be 
one in which work is accomplished 
with a minimum of attention given 
over to the checking process. 

The college class exercise seems 
doomed to change also. The lecture 
method is almost certain to be replaced 
by a lecture-conference method in 
which a maximum of student activity 
is evident. A syllabus will be worked 
out for each of the college courses. In 
this syllabus problems will be raised 
and bibliographical references will be 
given. Students will read several 





from among the many ref 
given. The class period will then 
devoted to the processes of in 

the opinions or pieces of objective ey. 
dence which are presented by the gey. 
eral authors to whom references wep 
made. In this way students will } 
trained in sifting evidence and in 
ganizing materials judged pertinent tp 
the issue under consideration. 

Equality of Educational Oppor. 
tunity. Obvious inequalities in edy 
cational opportunities are found today 
throughout our nation; inequalities 
almost as great are to be found withiy 
the borders of many states, and even 
within the boundaries of the counties 
within a given state. Local option in 
education has been taken to mean that 
each school district ‘is privileged to 
have as poor a school as it wishes 
Also, many school districts vote taxes 
heavier than common property can 
bear. 

The writer is unable to predict what 
the sources of school income will be; 
that is, whether real estate and mort 
gages shall constitute the bulk of tar 
able wealth or whether income taxes, 
inheritance taxes, sales taxes, and it- 
tangibles will have been shown to be 
the better sources of revenue. The 
fact with which the writer is chiefly 
concerned is that the wealth of the 
nation and state shall be taxed to sup 
port the education of the children of 
the nation and state. Wealth must be 
taxed where it is and revenue thus 
gained must be spent where the chil 
dren are. Inequalities in educational 
opportunity must be ironed out; all 
children must be given equal oppor 
tunities for education through the see 
ondary school period. Students em 
rolled in levels of education bore 
the secondary school may be ¢ 
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upon to bear from one-third to one- 
half of the costs to the taxpayer which 
are entailed in the instruction and 
other educational provisions which 
they use. It may be shown in 1940 
that free tax-supported education be- 
yond the secondary school shall be 
limited to a few who are exceptionally 
able and who need this subsidy. Others 
may be required to pay tuition cover- 
ing approximately one-half of the in- 
structional costs. 

The facts on mobility of the popu- 
lation of our nation—from one state 
to another, from the country to the 
city, from one city to another — all 
argue for good educational opportuni- 
ties for children in the areas where 
they are born. It now makes a great 
deal of difference to Long Beach, Cali- 
fornia, whether or not the educational 
opportunities are good in the rial 
areas of Iowa. In California today 
there are 3,600 school districts with 
as many possible varieties in the ade- 
quaey of school support. 

We recognize our small district sys- 
tem as a Massachusetts inheritance. 
The plan was used there but soon dis- 
carded. Perhaps the nation will have 
made progress toward larger school 
districts in 1940. According to the 
provisions of our National Constitu- 
tion, education is a business allotted 
te the state for control. Would that 
the state would assume the responsi- 
bility of directing the education of the 
children to the end that all children 
in the state may have adequate and 
nearly equal educational opportunities, 
whether the child must live in the city, 
in the mountains or desert, or in agri- 
cultural areas. Our present plan of 


control and support of education is 
nothing short of opportunism and po- 
litieal expediency; it smacks not of 
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clear thinking or sane judgment. It 
is the prediction of the writer that we 
will have made considerable progress 
toward state support of education and 
equality of educational opportunity by 
1940. 

Conclusion. It is predicted above 
that the enrollments in all levels of 
Education in 1940 will be as fol- 
lows: Kindergarten and Elementary, 
26,000,000; Secondary, 7,000,000; 
Normal Schools and Teachers’ Col- 
leges, 175,000; Colleges, Universities 
and professional schools, 1,250,000; 
and Special Schools, 700,000. It is 
estimated that the teaching of the 
36,000,000 students of 1940 will be 
carried on by 1,200,000 teachers. 
Soon after 1940, all elementary teach- 
ers will have four years of college 
training, while secondary teachers will 
have five years, and junior college 
teachers will have six years of college 
training. Moreover progressive col- 
lege teachers will have had training 
in educational methods. Teaching in 
1940 will consist in directing student 
experiences toward clearly defined ob- 
jectives with appropriate content. 
Classrooms will be built and equipped 
with special reference to subjects 
taught within their walls. Methods 
of learning will consist of a conscious 
well-directed attempt to develop abili- 
ties of individual students, films will 
be used to present scenes in literature 
and history, and processes in physical 
and biological sctences. Students will 
be trained in organizing materials 
and making judgments in classroom 
activities. A clearer vision of the 
need for education in our democracy 
will lead in the direction of state-sup- 
ported education and equalized educa- 
tional opportunities through the sec- 
ondary school period. 
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THE FUNCTION OF EXAMINATIONS 


Marx E. Hutrcnrson 


DEPARTMENT OF LATIN 
CORNELL COLLEGE, MOUNT VERNON, IOWA 


The relationship between measurement and marks is so close that to most college 

students the two words mean the same thing. The chance of securing employment, 

the opportunity for promotion, as well as the feeling of self-satisfaction are all gop. 
erned very largely by the mark that one receives from his instructors. 


T seems to me that examinations 
should accomplish at least three 
things: (1) they should help the 
teacher form an accurate judgment of 
the students’ attainments, (2) they 
should help the student organize his 
knowledge, if he has any to organize, 
(3) they should give aid to both stu- 
dent and teacher in diagnosing the 
weaknesses and lacunae in the stu- 
dent’s knowledge. By examination, I 
am referring to an achievement test 
in some college subject. As a matter 
of fact, many of the examinations 
which we give fall far short of attain- 
ing these objectives, which are not so 
easy as they sound. Objective number 
1 is particularly elusive, “to help the 
teacher form an accurate judgment of 
the students’ attainments.” Many 
teachers have their minds made up be- 
fore they give the examination what 
the student will do on it and this in- 
fluences their judgment which is ex- 
pressed by the grade or mark. It is 
the mark which causes all the trouble 
and around which a battle in educa- 
tional circles is raging this very hour. 
Of course credits and marks are insep- 
arable and they are the chief corner- 
stones of our educational structure. 
Many teachers and administrators are 
beginning to question our present cred- 
it and marking system and “that mo- 
gul of modern education,” the college 
registrar, is tottering on his throne or 


perhaps better his swivel chair. Pro 
fessor Henry Crew in his presidential 
address given before the 1929 meet- 
ing of the American Association of 
University Professors says: “This 
same principle, when applied to our 
marking system, brings out with 
frightful clearness the horrible mecha- 
nism by which we are trying to pro 
vide mass education and keep the lame 
ducks in the procession. Our marking 
systems, whether of daily, weekly or 
monthly grades, divert the student’s 
attention from the main thing, pro- 
duce a mistrust in his mind, give him 
an “on guard” attitude towards his 
professor, and lead him to conceal his 
ignorance, instead of indulging his 
natural and divine curiosity in frank 
discourse with his preceptor. But this 
is only half the story of marks. The 
instructor who examines on the sub- 
ject rather than on the text —the 
teacher who employs an attainment 
test rather than a trial of the memory 
—is under the present machinery al- 
most certain to suffer one of two evil 
consequences: either he reports the 
“standard” percentage of his students 
as passed and loses his self-respect, or 
he reports the facts and fails so many 
students that his dean upbraids him 
for poor teaching.” 

Let us put the ecards on the table. 
We all know that in all of our colleges 
three hours under Professor A are 
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worth six hours under Professor B, so 
far as student effort and grades are 
concerned. We know perfectly well 
that an A from Professor X is worth 
a © from Professor Y. But what can 
we do about it? We steadfastly main- 
tain that our own system of marking 
is above reproach, or practically so, 
but when it comes to our colleagues we 
could find much to criticize, if we were 
so inclined. In other words, credits 
are based on marks, and the marks are 
far from accurate. Even if they were 
accurate, too many students are inter- 
ested in grades rather than in accom- 
plishment. Nor do I blame them so 
much as the system. Perey Marks in 
his “Which Way Parnassus” may ex- 
aggerate a little, but very little, when 
he reports the following outbursts from 
students: “I worked like the devil in 
Math. and only got a D. The folks 
were awfully sore. I did all of Jim 
Jones’ problems for him and he got a 
B. Believe me I am not going to be a 
fish again. Watch me get an A.” An- 
other outburst, “I am sick of busting 
my neck over these blamed English 
themes. I sat up half the night work- 
ing on one and only pulled a D. And 
Bill Smith copied his out of the Lit. 
Dig. and got a B+. You can bet I’m 
not going to lose sleep any more just 
for nothing. I am going to buy the 
Lit. Dig. myself.” Mr. Marks says 
the most honest examination ever 
handed in to him was as follows: 
“There’s a beautiful fog down on the 
beach today, and I don’t feel like play- 
ing at being Mr. Wiseman with you. 
You can play at being Mr. Wiseman 
with the other little boys. I am go- 
ing down and play in the fog.” 
Dean Haggerty of the University of 


1 Cf. Raymond A. Kent, “Higher Education 
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Minnesota has said: “There can be 
little effective study of college teach- 
ing and little intentional improvement 
in it until we discard the present 
marking system, or supplement it with 
corrective devices that render it intel- 
ligible. More than twenty years ago 
it was clearly demonstrated that the 
marking system employed in most 
schools and colleges is statistically un- 
reliable. Since that time scores of 
statistical studies have been made all 
confirming this fact. Notwithstanding 
the accumulating evidence, colleges 
have been slow to devise better meth- 
ods and have for the most part de 
clined to adopt the improved tech- 
niques recommended to them. . 
Investigation has not revealed any 
complete panacea for the defects of 
the present marking systems, but two 
methods of improvement that promise 
usefulness may be commended. The 
first is the percentile technique of 
recording student standings in exami- 
nations and courses: the second is 
objective examinations.”? 


At the University of Chicago an 
experiment has been started where 
credits and years will be disregarded 
and achievement will be measured, as 
accurately as possible. The measure- 
ment by time will be done away with 
and the students’ achievement will be 
measured by a comprehensive series 
of tests, many of them objective, con- 
structed by both subject specialists and 
experts in the testing field. Reports 
coming from the University of Chi- 
cago indicate that this new plan of 
scrapping the old system of marks and 
credits has made a good start. At 
Oberlin College beginning with the 
year 1930-31 there was adopted a 


in America’: Ginn and Co. (1930), 507-508. 


























ranking system instead of the usual 
method of giving literal grades. At 
the end of the semester each teacher 
sends to the registrar’s office a list of 
his students in the order of excellence. 
The ranks of the passing students are 
then converted into a score by the 
registrar by means of a conversion 
table.” 

All of this may seem rather far 
afield from my subject, “the function 
of an examination,” but there can be 
no discussion of examinations without 
a criticism of the system of grades and 
credits now generally in use. Surely 
our examinations test us who make 
them as much or more than they test 
those who take them. Several years 
ago 116 candidates for teaching certi- 
ficates in the state of New Jersey took 
an examination and not one of them 
passed it. Asa result, the State Com- 
missioner of Education ruled that this 
examination did not constitute “an 
adequate instrument of the work of 
the normal schools and can not be re- 
garded as a valid test for the selection 
of teachers.” And that brings us to 
the most important thing we can ask 
ourselves about our examinations—are 
they valid? That is, do our examina- 
tions test for what they are supposed 
te test. A test on Art Appreciation 
should test for art appreciation and 
not for the ability to draw or paint or 
what not. In order to make a valid 
test an instructor must know what he 
wishes to accomplish in his course and 
his students must be made aware of 
his aim. A teacher who has badly 
organized his course or does not know 
his subject will not make a valid test. 
In his efforts to make a valid test the 


2 Cf. Carl C. W. Nicol, 
(1932), 21-25. 
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“The Ranking System,” 





instructor will construct his course ip 
orderly fashion. He will have certain 
objectives and his teacher procedure 
will be directed towards attaining 
these aims. 

There can be little doubt that objec. 
tive tests are more likely to be valid 
than the traditional examinations jn 
essay form. Therefore all college 
teachers should experiment with this 
type of test and become familiar with 
the technique of constructing such 
tests. Not only should teachers con. 
struct objective tests for use in their 
teaching, but they should use stand- 
ardized tests in their own field, so far 
as they are available. Of course the 
chief purpose of a standardized test is 
to compare what your students are do 
ing with what the average or norm is 
accomplishing and then to bring your 
students up to the standard or beyond, 
if humanly possible. The instructor 
can also discover certain habitual er- 
rors which his students are making. 
While I believe that a well-made ob- 
jective test is more likely to be valid 
than an essay form of test, we should 
use both kinds of tests, for after all 
the student needs some practice in 
writing English and must not spend 
all of his time checking true-false and 
multiple-choice exercises. If I were 
asked by some particularly credulous 
reader of this paper just how he should 
use these new-fangled tests, as he 
might call them, I would advise him 
(1) to give his students a placement 
examination in order that they may 
be placed with students of approxi- 
mately the same attainment.* (2) to 
give early in the course a good stand- 
ardized achievement test in order to 
The Journal of Higher Education, Ill 


3 The Iowa Placement Examinations and Aptitude Tests are probably the best known tests 
of this nature. They can be obtained from the Bureau of Educational Measurements, State 


University of Iowa, Iowa City, Iowa. 
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see what his students actually know 
(3) to give a duplicate form of this 
game test towards the end of the se- 
mester so that he may find out whether 
they have learned anything. (4) to 
make his own informal objective tests 
and make them as valid as he possibly 
can. These should be given frequently 
and they will serve as teaching devices 
as well as tests. (5) to give a com- 
prehensive test to all of his major 
‘students before they graduate. The 
nature of this test would vary with 
the department. 

The more one works with tests and 
examinations the more fascinated he 
becomes with the subject. Doctor 
F. J. Kelly has laid down the follow- 
ing as needed research along the line 
of examinations and marks. I see no 
reason why any self-respecting college 
should hesitate to tackle these prob- 
lems. They are: “(1) a statistical 
study of marks given by teachers. 
They should include (a) distribution 
by teacher, department and school (b) 
correlation of marks in various sub- 
jects with other criteria of ability such 
as intelligence tests, vocational success 
or part taken in worthy non-voca- 
tional enterprises. (c¢) relation be- 
tween marks and withdrawal from col- 
lege. (2) experimentation with the 
development and use of the more ob- 
jective forms of tests and examina- 
tions. (3) experimentation with sub- 
stituting for grades and credits in the 
individual subjects in the senior col- 
lege a single comprehensive examina- 
tion over the whole field of concentra- 
tion.’”4 

The moral of this paper, if it has 


4 Cf. F. J. Kelly, “The American College’”’ 
5 Cf Cc. C. Little, 
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one, runs somewhat as follows: Our 
method of marking and giving credits 
is faulty. We are too much the devo- 
tees of time and the registrar’s office. 
The way out is a difficult one and 
seems well concealed but we must find 
it. Perhaps Chicago is blazing the 
trail. Perhaps not. We should be 
sure that our examinations are valid. 
Our students should be examined soon 
after entrance by placement and 
achievement tests and placed where 
they belong regardless of the amount 
of time they have or have not spent 
on the subject. We should consider 
seriously the advisability of introduc- 
ing comprehensive examinations for 
our major students or perhaps for 
each field of concentration. We should 
not think our examinations perfect, 
even if they be objective tests. We 
should possibly adopt some method of 
percentile ranking of our students 
rather than giving them an A or flunk- 
ing them. Until this method is 
adopted officially, we can use it unof- 
ficially in our own classes. 

Finally, when we give our exami- 
nations let us avoid the following ob- 
jectives with which, according to Dr. 
©. C. Little, the former President of 
the University of Michigan, most oral 
examinations for the Ph. D. degree 
are given. These objectives are: “(1) 
to impress the other examiners with 
the fact that he, the questioner, has 
kept up to date intellectually. (2) to 
bewilder the candidate by asking ques- 
tions which he cannot answer. (3) to 
hide the fact that the examiner is un- 
familiar with the field in which the 
candidate is specializing.””® 


: New York, Macmillan Company (1925), page 133. 
“The Awakening College” page 136. 


: W. W. Norton and Co. (1930), 








BREAKING THE FOREIGN LANGUAGE GOOSE STEpe 


Water Vincent KAvLFrers 
LONG BEACH JUNIOR COLLEGE, LONG BEACH, CALIFORNIA 


A plan that “leads to the acquisition of measureable skills”; that “makes m 

achievement the basis of the marking system”; that “increases enrollment in the 

upper divisions”; and that “lessens the instructional labor of correction,” sounds. 
almost too good to be true. 


N a sense, the goose step in the for- 

eign languages constitutes far more 

a pragmatic ideal than a necessary 
evil. If the ordinary language peda- 
gogue could align his charges into 
companies of identical size and stat- 
ure, and could make all advance with 
equal pace toward the simultaneous 
achievement of a uniform goal, he 
would not fail to think that the sum- 
mum bonum and the ne plus ultra in 
class organization had been accom- 
plished. 
- That a mechanically controlled ho- 
mogeneity of achievement in the for- 
eign languages is next to impossible, 
however, scarcely requires confirma- 
tion. Every teacher of experience has 
found in his beginning classes pupils 
who at the end of the term acquired 
as much ability in vocabulary, oral 
reading, or comprehension, as students 
in the third and even fourth semesters 
— pupils who, had the opportunity 
been afforded them, might easily have 
made similar progress in grammar 
and composition. Conversely, there is 
no instructor of foreign languages who 
has not entertained in his advanced 
courses students who from all the evi- 
dence of standardized tests had never 
progressed beyond the elementary 
stages. The prevalence of this condi- 
tion in the foreign language field has 
been made patent by the comprehen- 


sive investigations of Ben D. Wood in 
New York, and by every study of the 
problem reported since that time.’ To 
illustrate the gravity of the situation 
a few examples may be taken from 
life. The following are actual cases 
discovered in a study of 663 pupils of 
beginning Spanish in eighteen junior 
high schools of Los Angeles and Long 
Beach in 1931: 

Case A, a boy enrolled in ninth 
grade beginning Spanish, Long Beach, 
IQ 91, made a total score of 185 on 
the Columbia Research Bureau Span- 
ish Test. 

Case B, a girl, IQ 110, enrolled 
with the same teacher, made a total 
score of 23 on the same test. 

Case C, a girl enrolled in beginning 
eighth grade Spanish, Los Angeles, 
IQ 118, made a total score of 0 
(zero) ! 

Case D, a girl of the same IQ, en- 
rolled in the same grade, achieved a 
total score of 229! 

These examples, though extreme, are 
indicative of a general condition. 

The challenge of the problem has 
been met in some institutions through 
differentiated assignments, supplemen- 
tary readings, and honors courses, but 
tu the present time the principles gov- 
erning the organization of a remedial 
plan, and the mechanics of its admin- 
istration, have not been sufficiently 


* The essential features of the plan have long been in successful operation in the English, 
Mathematics, Science, and Social Studies departments of the Woodrow Wilson High School, 
Long Beach, California, under the direction of Dr. William J. Klopp, director of teaching. 


1 Ben D. Wood. 


“New York Experiments with New Type Modern Language Tests."’ The 
Macmillan Company, New York, 1927, 339 pages. 


See also: Walter Kaulfers. “Effect of Mental 


Age on Foreign Language Achievement,”’ in Journal of Applied Psychology, vol. XI, no. 3, 


pp. 257-268 (June, 1930). 
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understood to lead to a concerted pro- 

of reform. Although it is still 
impossible to point to such a solution 
jn practice as promises feasibility for 
all levels of foreign language work 
from the junior high school to the col- 
lege, sufficient experience in other aca- 
demic fields is available to furnish the 
basis for a mode of attack. At least 
the following premises may be consid- 
ered corroborated by scientific evi- 
dence: 

1. No solution is likely to prove 
efficacious which depends upon a homo- 
geneous grouping of pupils into fast 
and slow moving sections, for not a 
single basis of classification, from 
1Q’s and prognosis tests to measures 
of vernacular ability in English and 
General Language, yields a sufficiently 
high correlation with achievement, 
either singly or in combination, to as- 
sure an accurate individual placement 
ef beginners for all schools.? 

2. In general, the problem consti- 
tutes as much a question of individual 
differences in interest, motivation, and 
industry as of aptitude or capacity, 
and in consequence cannot be solved 
solely by prognostic methods. It com- 
pels such a motivated individualization 
of instruction as makes possible for 
each student a rate of progress com- 
mensurate with his interests, abilities, 
and ambitions. 

The only obstacle in the way of such 
an ideal is the feasibility of its appli- 
cation in school life. To be at all ex- 
pedient in practice, the plan requires 
the organization of subject matter into 
a graduated series of specific content- 
units, or mastery-unit exercises, suit- 
able for successive completion by the 
student independently of the class and 


of the instructor. Obviously, the exer- 
cises must be sufficiently limited in 
scope to permit of brief explanations 
for self-instruction, plentiful enough 
in practice material to insure a mas- 
tery of the principles or content in- 
volved, and sufficiently simple and ob- 
jective in organization to permit of 
ready correction from uniform keys.® 
Beyond this it is desirable that norms 
of achievement be reported on each 
unit for the edification of the student 
in orientating him in standards of 


work, as well as for the information 


of the corrector in the subsequent scor- 
ing and grading of papers. The 
norms can in most cases be determined 
through preliminary tryouts on repre- 
sentative class groups, and can be re- 
vised or extended with experience from 
year to year. For those students who 
fail in attaining the minimum stand- 
ard, alternate exercises are essential 
for supplementary drill. Finally, a 
set of brief 10 to 15 minute objective 
tests—one test of two forms for each 
unit — with corresponding norms, is 
imperative. For facility in adminis- 
tration, the material should be mimeo- 
graphed and bound in booklet form, 
the syllabus of mastery-unit lessons to 
be kept by the pupil, and the pamphlet 
of tests by the instructor. 

When the student shows evidence of 
having completed satisfactorily a unit 
of work, he applies for the correspond- 
ing mastery-unit test. On the desig- 
nated examination days he receives his 
quizz-book, and demonstrates his abil- 
ity to apply the subject matter of the 
lessons independently of outside aid. 
The order in which the mastery-unit 
tests and subsequent practice exercises 
are completed is uniform for all stu- 


2 Walter Vincent Kaulfers, ‘‘Present Status of Prognosis in Foreign Language,’’ in School 
Review, vol. XXXTIX, no. 8, pp. 585-596 (October, 1931). 

3 For a complete discussion of the construction and validation of mastery-unit exercises, 
with practical illustrations for a specific language, see: Walter V. Kaulfers. ‘“‘The Mastery- 
alt oe in Foreign Language Teaching,” in Hispania, vol. XIII, no. 5, pp. 417-430 (Novem- 

> 0). 
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dents, but beyond the motivation nec- 
essary in special cases, the rate at 
which the units are finished is left to 
the pupil. 

As soon as all units for the semester 
have been mastered, and in any case 
at the end of the term, the student is 
given a comprehensive standardized 
test to determine his general achieve- 
ment in the language. If his score 
attains the norm for the course, he is 
given full credit for the semester, and, 
provided the class schedule permits of 
transfer, is promoted at once to an 
advanced class;* otherwise, he begins 
work on the succeeding units while 
remaining with his group. 

Marks under this plan are awarded 
on the basis of both rate of progress 
and proficiency in subject matter, as 
follows: 


A grade of A (excellent) is earned by 
1. Achieving a score on the com- 
prehensive examination within 
+ .5 standard deviation of the 
norm at least seven weeks before 
the end of the term; or by 
2. Achieving a score at least + 1.5 
standard deviation above the 
norm at the end of the term.® 
A grade of B (good) is earned by 
1. Achieving a score on the com- 
prehensive examination within 
+ .5 standard deviation of the 
norm at least four weeks before 
the end of the term; or by 
2. Achieving a score at least + .5 
standard deviation above the 
norm at the end of the term. 
A grade of C (fair) is earned by 
achieving a score on the comprehen- 
sive examination within + .5 stand- 





ard deviation of the norm at the end 
of the term. 

A grade of D (passing) is earned by 
achieving a score between -.5 and 
—1.5 below the norm for the com- 
prehensive examination at the end 
of the term. 

No grades below D are given, since 
sub-average achievement is ade 
quately penalized by a reduction of 
credit. 


For purposes of class instruction, 
the recitation time in fifty-five minute 
periods is budgeted as follows: 

The first fifteen minutes on Tues 
days and Fridays are devoted to the 
administration of mastery-unit tests, 
Although relatively few students are 
eligible for the same examinations on 
the same days, no confusion arises 
from this source, since the questions 
are planned to occupy the full time of 
each pupil during the testing period, 
and the time-limit in all cases is uni- 
form. At the beginning of the hour, 
the mimeographed quizz-books (previ- 
ously collected in order of seating to 
facilitate distribution) are passed to 
the pupils. The desired exercises are 
readily accessible, for all completed 
tests have been torn out, thus leaving 
the appropriate questions exposed 
when the cover is opened. 

The first fifteen minutes on Mon- 
days, Wednesdays, and Thursdays, 
and the second fifteen minutes on 
Tuesdays and Fridays (the testing 
days), are reserved for the open-forum 
discussion of language problems raised 
by the students. Typical questions for 
this period are the position or agree 
ment of adjectives, the distinction be 


4 In answer to the objection that this plan runs counter to university requirements, it 
should be pointed out that since the problem is ultimately one of bookkeeping, and affects only 
a small percentage of the students, the difficulty can be met in most cases by enabling pupils 
who transfer from a lower course to a higher to receive credit in both classes—i. e., the tran- 
scripts may show simultaneous enrolment in two courses. 


5 Scores more than —.5 standard deviation below the norm on advanced examinations are 
disregarded in grading, since the students are obliged to take another form of the test at @ 
later time before marks and promotions are granted. 
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tween the imperfect and the preterite, 
the uses of the subjunctive, and simi- 
lar items, depending upon the nature 
of the course. These problems are dis- 
eussed by the instructor before the 
class, in such a way as to capitalize 
the knowledge of pupils who have al- 
ready completed the corresponding 
ynits of work. For the precocious 
students this period serves as a moti- 
vated review, while for the laggards 
it affords an invaluable opportunity 
for acquiring advance information on 
vital questions that all are destined 
sooner or later to meet. It cannot be 
urged too strongly that instruction 
given in these circumstances, in re- 
sponse to felt needs, is destined to be 
attended far more intently by the 
group, and therefore to be fixed more 
permanently for subsequent applica- 
tion, than information offered gratis 
on less auspicious occasions. 


The remainder of the class hour— 
forty minutes on three days, twenty- 
five minutes on two days—is devoted 
at the instructor’s discretion to class 
recitation, or, in junior and senior 
high school, to supervised study with 
special aid on personal problems. In 
order to allow as much time as pos- 
sible for individual progress, no uni- 
form assignments are given. In other 
words, the group work is limited to 
supervised sight-reading from the text 
(with questions and answers) ; infor- 
mal dramatizations; games or songs; 
and discussions by the instructor of 
selected phases of foreign life, litera- 
ture, and custom. Reading is chosen 
as the major class activity since it 
comes nearest toward representing the 


ultimate aim of foreign language in- 
struction in the United States,® and 
because in groups of varying individ- 
ual abilities and preparation, such as 
must be anticipated under the plan, 
it is perhaps the only type of class 
work that permits of a profitable par- 
ticipation on the part of all pupils. 
To avoid the repetition of class work 
for students who fail of promotion to 
advanced groups, a different reader 
from the one used in the fall is read 
in the spring. 

Inasmuch as the difficulties sur- 
rounding such a proposal — the want 
of suitable instructional materials,’ 
the disagreement among teachers con- 
cerning aims and standards of achieve- 
ment, etc.—are too obvious to require 
mention, the discussion of the project 
may more profitably conclude with a 
consideration of possible merits. In 
favor of the plan the following advan- 
tages are proffered: 

1. It shifts the emphasis from 
time-serving to achievement in the 
adjudication of credit, thus making 
each semester of foreign language 
work lead to the acquisition of measur- 
able skills and abilities, rather than 
to the mere accumulation of credit 
hours. 

2. It makes measurable achieve- 
ment the basis of the marking system, 
thus stimulating a higher type of 
scholarship by reducing the popularity 
of the “gentleman’s ©” and the 
“bench-warmer’s D.” 

3. It enables the best students to 
attain the advanced stages of foreign 
language work in from two-thirds to 
one-half the usual time, thus operat- 


6 Algernon Coleman. ‘“‘The Teaching of Modern Foreign Languages in the United States.” 
The Macmillan Company, New York, 1929, 299 pages; page 170. 

7 In large schools the composition of the units can be made a departmental project, each 
teacher undertaking the treatment of a specific topic. This division of labor materially reduces 
the load per teacher and eventually results in a comprehensive library of useful material, 
while the subsequent pooling of exercises makes possible interesting comparisons between dif- 
ferent groups. If the exercises are made self-instructional, they may entirely displace the 


usual grammar. 
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ing effectively to increase the enroll- 
ment in upper division classes. 

4. It is adapted alike to intra- 
group and self-competition, thus exer- 
cising a salutary influence upon 
achievement and scholarship. 

5. It lessens the instructional labor 
of correction: the objectivity of the 
tests and exercises permits of a ready 
checking and scoring of responses 
from uniform keys by advanced stu- 
dents. 

6. Since the number of promotions 
within any semester amounts only to 
a limited percent, the heterogeneity of 
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class groups becomes no greater under 
the mastery-unit plan than under preg. 
ent conditions; while with reading ag 
the major class activity, individual 
differences can readily be accommo 
dated in the recitation. 

7. The plan requires a scientific 
organization of subject matter into 
psychologically spaced units of gradu- 
ally inereasing difficulty, with norms 
and measures of achievement. Conse. 
quently, it stimulates a wholesome 
analysis and re-evaluation of content, 
activities, and standards on the part 
of foreign language departments. 


YOUR SCHOOLS AND MINE 


Roy C. Woops, Pu. D. 


PROFESSOR OF EDUCATION, MARSHALL COLLEGE, 
HUNTINGTON, WEST VIRGINIA 
In this department Dr. Woods will answer to the best of his ability any or all quea- 
tions on educational topics that are addressed either to him at the address above, or to 
Epvucation. It is to be understood that the writer alone is responsible for the answers 
given.—H. B. 





“My dear Dr. Woods: May a reader 
take exceptions to what you say as 
well as ask questions? If so, I want 
to say that I think the teacher you 
quoted in the December issue in her 
solution of the problem of snobbish- 
ness was to be condemned instead of 
held up for commendation. Aside 
from the pragmatic consideration of 
“having worked in this case,” it has 
nothing to commend it. It resembles 
the “eye for an eye” doctrine too much 
to suit me. I think she should have 
had talks on sportsmanship, democ- 
racy, rights of the other fellow, ete. 
She should have used the class period 
to teach proper citizenship, school 
spirit and the like. This seems to me 
to be the positive approach, while the 
other the negative one. . . .” 


I submit this excerpt to show to all 
two things. Yes! you make take ex- 
ception and I am pleased to hear from 
you. Furthermore, I am going to say 
I agree with what you have said. The 
only trouble is you didn’t say enough. 
What are you going to do when your 
method failed. I have learned, or 
think I have, that there is no sure 
eure for any set of problems we 
teachers meet. What works with one 
pupil will fail with another and will 
have opposite results, i. e., antagonize 
another. In the case I quoted, “it 
worked,” as you say, and I think that 
“nothing sueceeds like success.” I 
should rather solve it your method, 
but when it fails then something more 
severe is needed. 


May I illustrate with expulsion! 
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Ordinarily I object to the use of it 
in discipline. Legally no one but the 
board can expel a pupil. Teachers are 
only permitted to suspend. It closes 
the doors of opportunity and in many 
eases merely confirms the offender in 
his anti-social tendencies. But if all 
other means have failed and the of- 
fender still violates his privileges, sus- 
pension will at least protect other 
members of the group who are social 
in their outlook and actions. Many 
times, too, it “works.” 

May I hear from you again as to 
how you would handle the case if 
your above methods failed ? 


What is the status of manuscript 
writing? Has it proven its worth in 
classroom methods? 


Personally I doubt it. I am in- 
clined to feel that it is still in the 
experimental or opinion stages. Moss- 
man, in her recent book published in 
1929, “Teaching and Learning in the 
Elementary School,” says that it “re- 
cently came to us from England. It 
is being used in a large number of 
private schools and some _ public 
schools. Study is being made of the 
results, so that, in time, definite data 
as to its value will be available.” I 
suggest that you turn to page 200 of 
the above reference for her discussion 
of its values and limitations. 


I am the principal of an elementary 
school and would like to know when 
I should schedule my teachers meet- 
ings. Should they be at the noon hour 
or after school? 


As a principal you should read 


Reavis, Pierce and Stulken’s new 
book “The Elementary School.” You 
will find some valuable suggestions in 
the book relative to administration of 
this type of school. I frequently refer 
to it in my work. They suggest that 
two types of meetings be held. One, 
of a short administrative nature, at the 
noon hour any day, where routine mat- 
ters can be dispensed with in short 
order. The longer one, of a scientific 
nature, to be held after school at a 
convenient date for the teachers, where 
longer discussions of policy and theory 
or practice can be held. You will find 
that no date will be satisfactory to all, 
yet you can arrange one that will suit 
most. 


Do you feel that the segregation of 
handicapped children into specialized 


rooms ts desirable? 


In most cases, yes. Certainly no 
one would say that tubercular chil- 
dren, certain types of disciplinary 
eases should be kept in with normal 
children. Deaf-mutes, blind children 
and crippled ones will need part seg- 
regation, depending upon their handi- 
cap. Until they can profit more by 
ungrouped classes they should be seg- 
regated. As to ability grouping, 
which is probably what my questioner 
has in mind, you will find wide 
differences of opinion. I think such 
grouping, properly handled, to be dis- 
tinctly advantageous. McGaughey is 
one of the most active opponents of 
the movement, while Terman, Otis, 
Thorndike, Freeman and others, de- 
fend its value. 
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Introduction to the History of the 
Social Science in Schools. By Henry 
Johnson, Professor of Education, Teachers 
College, Columbia University. Scribner's, 
1932. 145 pp. 

The broader the base relative to the 
height of an object, the more stable it be- 
comes. This volume by Dr. Johnson broad- 
ens the basis in the field of social science, 
by reviewing the important methods of 
teaching which have been used or advo- 
cated through the centuries. It is illumi- 
nating to learn that Weise as early as 
1680 emphasized the vital unity of geog- 
raphy and history; that Basedow, 1770, 
advocated teaching history backward, be- 
ginning with the present problems and 
the use of national holidays as centers of 
interest for backward looks; that Chris- 
tian Trapp about 1800, introduced note- 
books much like our present work-books 
and also used a form of true-false test; 
that loading the minds of children with 
poorly comprehended facts was con- 
demned by Frederick the Great, who is 
entitled to be ranked as an educator as 
well as a ruler and general. 

The present combining of subjects into 
the Social Sciences may be traced from 
Pestilozzi through Harnich, Ziller’s trea- 
tise on Herbart, and the American Her- 
bartians, De Carmo, Frank and Charles 
MeMurry, and Francis W. Parker. The 
idea of history as a means of propaganda 
or indoctrination was alive at the time of 
the French Revolution and has been since 
used in all Central European countries. 
Thus we discover that the Social Studies 
Report of 1916 contributes scarcely a new 
idea. 

Dr. Johnson’s treatment is a brief one, 
reads easily, is pointed and definite in its 
viewpoint. It shows the origins of pres- 
ent practices. Any teacher of history or 
the social sciences would be greatly stimu- 
lated by reading it. It gives perspective 
and makes present workers realize that 
creative ideas in the field, however new 


they may appear to the creator, have in 
most cases been “new creations” again 
and again through the centuries.—Gyy 
M. Witson, Boston University. 


Administration of the Testing Pro- 
gram. By Clifford Woody, Director of 
Bureau of Educational Reference and Re- 
search, University of Michigan, and Paul 
V. Sangren, Director of Bureau of Educa- 
tional Research, Western State Teachers 
College, Kalamazoo, Michigan. World 
Book Company, pp. 397, price $2.00. 


In the Educational Review for March, 
1926, Dr. Guy M. Wilson of Boston Uni- 
versity called attention to the fact that 
the ends which should be served by test- 
ing were more fundamental than the test- 
ing itself; that a test that did not rein- 
force right curricular principles, encour- 
age proper methods of teaching and serve 
the true purposes of an examination, i.e., 
provide for a new view or worth-while 
applications of material taught, was to 
be rejected regardless of its statistical 
and mechanical excellence. 

In other words, the administration of 
the testing program is quite as important 
as the tests themselves. The authors have 
here answered the many questions regard- 
ing testing that have been asked them 
as directors of research bureaus. Out of 
their many years of experience in this 
field they have made a job analysis of 
the tasks involved in an effective testing 
program and have presented here a sum- 
mary of the techniques involved in the 
administration of the program. 

Such topics as scoring the tests, tabu- 
lating the results, using test results for 
the improvement of instruction and ac- 
quainting the public regarding the effici- 
ency of the local school system, are 
treated in most interesting and practical 
fashion. 

The last two chapters (Dangers to be 
Avoided in Using Tests and Present Ten- 
dencies in Measurement) should be made 
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required reading for all teachers and ad- 
ministrative officers. Each chapter would 
make a most excellent topic for discus- 
sion at a general teachers meeting. 


Modern Business Geography. Revised 
edition, 1932. By Ellsworth Huntington, 
Research Associate in Geography, Yale 
University, and Sumner W. Cushing, late 
Head of the Department of Geography in 
the State Normal School, Salem, Massa- 
chusetts. Introduction by Frank M. Me- 
Murry, Teachers College, Columbia Uni- 
versity, 352 pp. Price $1.96. World Book 
Company, Yonkers-on-Hudson, New York. 

The authors are well fitted by training 
and experience for the piece of work un- 
dertaken. Dr. Huntington of Yale is an 
outstanding climatologist and a careful 
student. The late Sumner W. Cushing 
was an able young scientist and a normal 
school teacher of high order. 

Geography was originally considered to 
be a subject for the upper schools. For 
many years, however, it was looked upon 
as being exclusively an elementary school 
subject—and it still is by many. Geog- 
raphy is again slowly but surely winning 
its way into the secondary schools. Un- 
fortunately, high school geography has 
been associated with anaemic courses in 
comercial geography, in which stress has 
been placed upon memorization of lists 
or products and their sources. Little em- 
phasis has been placed upon the “why” 
side of geography; and geography on any 
level is essentially a study of relation- 
ships. Huntington and Cushing’s Modern 
Business Geography, while an economic 
geography, has not neglected this very 
important aspect. The student is called 
upon to consider problems for which the 
text has given the necessary background 
and to make use of geographical facts in 
thinking for himself. The book shows how 
the world’s work is done and how it is 
affected by geographical conditions. This 
stress on cause and effect makes the book 
of real value in the teaching of geography. 

Especially valuable are the problems 
and exercises found at the end of each 
chapter. They require thought to answer. 
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Of course, without an enthusiastic teacher, 
even these problems may not function as 
intended, 


One of the outstanding features of the 
book is that of making “figures talk.” 
Making statistics meaningful is one of the 
outstanding contributions of the new 
school of geography teachers. The statis- 
tics are as up-to-date as it is possible to 
have them in a geography text-book. 

There is a wealth of illustrative mate- 
rial and the pictures are well chosen. 
There is a splendid set of maps and 
graphs well adapted to a text-book in the 
field of economic geography. 

The book is to be commended for its 
mechanical makeup, also. The convenient 
size of the book, the quality of the paper, 
and the clearness of details in the pic- 
tures, maps, and graphs, are worthy of 
mention. An excellent list of references 
in the field of business geography is given. 


The Introduction by Professor Frank M. 
McMurry of Columbia University, while 
brief is a clear and keen statement as 
to what business geography should aim to 
achieve. The teacher will be repaid by 
making a careful study of this statement 
—made by one who has been out standing 
in the field of geography teaching for 
many years.—FRANKLIN C. ROBERTS. 


How to Make Pupil-Made Lantern 
Slides. By G. EH. Hamilton. Meadville, 
Pennsylvania: Keystone View Company, 
1932, pp. 10. 

Mr. Hamilton is the author of many 
practical articles and pamphlets on Visual 
Instruction. His latest one will be most 
useful in solving the problem of the home- 
made lantern slide, which has become so 
popular. It tells about the pencil-made 
lantern slides, ink-made lantern slides, 
Keymo lantern slides, and cellophane lan- 
tern slides. Teachers and pupils are ob- 
taining excellent results with clear and 
etched glass illustrations of their own 
classroom activities. This booklet should 
certainly be in the possession of every 
teacher who is using visual aids—F. D. 
McC. 
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Our Nation Begins. By Hugene OC. 
Barker, Head of the Department of His- 
tory, University of Texas, William U8. 
Dodd, Head of the Department of History, 
The University of Chicago, and Walter P. 
Webb, Associate Professor of History, Uni- 
versity of Texas. 1932. 342 pp., illus- 
trated, cloth $1.00. Row, Peterson & Co. 


The Story of Our Nation. 
authors as above. 1929. 
illustrated, cloth $1.28. 
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Our Nation Grows Up. By the same 
authors as above. 1932. 334-18 pp., illus- 
trated, cloth $1.00. Row, Peterson & Com- 


pany. 


Old Europe and Our Nation. By 
Eugene C. Barker, Head of the Depart- 
ment of History, University of Texas, 
Frederick Duncalf, Professor of Medieval 
History, University of Texas, and Francis 
Leonard Bacon, Principal of Evanston 
Township High School, Evanston, [linois.. 
476 pp., illustrated, cloth $1.28. Row, Pe- 
terson & Company. 


The Growth of a Nation. The United 
States of America. By Hugene C. Barker, 
Head of the Department of History, Wal- 
ter P. Webb, Associate Professor of His- 
tory, The University of Texas, and William 
2B. Dodd, Head of the Department of His- 
tory, The University of Chicago. 686— 
xxxvi pp., illustrated, cloth, $1.80. Row, 
Peterson and Company. 


The Human Personality. By Louis 
Berg, M.D., Deputy Medical Supervisor, 
Department of Health, New York City, 
and Member of the Faculty, School of 
Education, Washington Square College, 
New York University. 321 pp., cloth, 1933. 
$3.00. Prentice-Hall, Inc. 


Lateral Dominance and Visual Fusion, 
By Charles A. Selzer, Head of the Depart. 
ment of Education, State Teachers Col. 
lege, West Chester, Pa. The Harvard Mon- 
ographs in Education, No. 12. 1933. 119 
pp-, paper, $1.00. Harvard University 
Press. 


The Evolving Common School. The 
Inglis Lecture, 1933. By Henry C. Morri- 
son, Professor of Education, The Univer. 
sity of Chicago. 1933. 62 pp., cloth, $1,090, 
Harvard University Press. 


Pompilia and Her Poet. By Harriet 


Gaylor. Third edition (Revised 1932), 
198 pp., cloth. Modern Classics, publish- 
ers. $2.00. 


Educational Yearbook of the Interna- 
tional Institute of Teachers College, Co- 
lumbia University, 1931. Edited by i. L. 
Kandel, M.A., Ph.D., Professor of Educa- 
tion and Associate, International Insti- 
tute, Teachers College, Columbia Univer- 
sity. 721 pp., cloth, 1932. Bureau of Pub- 
lications, Teachers College, Columbia Uni- 
versity. 


Administration of the Testing . Pro- 
gram. By Clifford Woody, Ph.D., Director 
of Bureau of Educational Reference and 
Research, University of Michigan, and 
Paul V. Sangren, Ph.D., Director of Bu- 
reau of Educational Measurement and 
Research, Western State Teachers College, 
Kalamazoo, Michigan. 1933. The World 
Book Company. 397 pp., cloth, illustrated. 
$2.00. 


Biology for Beginners. By Truman J. 
Moon, Head of the Science Department, 
The High School, Middletown, N. Y., and 
Paul B. Mann, Head of the Department 
of Biology, Evander Childs High School, 
New York City. 1932. 741+4xxxii pages, 
cloth. Henry Holt & Company. 
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